Principal Data Streaming Engineer (Cloud)

To research, evaluate, design, implement, and maintain systems and product solutions, applying expert knowledge of engineering principles. Assist with coordinating activities between multiple disciplines within IT and vendors on both technical and non-technical issues pertaining to computer system hardware and software, network infrastructure, peripheral evaluation, and integration. Considered subject matter expert and a key stakeholder/key contributor on complex initiatives and project teams. Conduct complex work assignments under limited supervision. Cloud Engineering: Delivery of the computing services and the duties associated with it such as designing, planning, administering, developing, or maintaining applications in the cloud-based environments.

• Lead integration of product technologies with respect to software for multiple on-going projects 
• Define the design and delivery of applications adhering to best practice for Event-driven architecture (EDA). Solutions will support large transactional volume allowing loose coupling and asynchronous events but ensuring guaranteed delivery and proper message ordering to synchronize multiple transactional systems 
• Drive system requirements, system specifications, input/output processes and working parameters by using systems engineering best practices
• Lead the development work streams responsible for creating compliant platforms
• Responsible for systems analysis, design, development, integration, enhancement, and deployment as well as application support for various applications
• Lead the deployment of new modules, upgrades and fixes
• Define, develop or modify software application modules or enterprise wide software systems using disciplined development processes
• Implement integration plans and interface with testing teams to incorporate plans into the integration testing process
• Prepare and present functional design specifications and design project process flow
• Provide specific detailed information for hardware and software selection, implementation techniques and tools for the most efficient solution to meet business needs
• Research, evaluate, recommend, and implement information technology that aligns with business needs and meets objectives
• Use holistic knowledge of all products in the information technology ecosystem to plan how new systems will be built and integrated
• Install, maintain, and perform configuration of infrastructure applications
• Create and manage life cycle of technical specifications from which programs and configurations will be applied to create the application, infrastructure or complete solution
• Review solutions to ensure alignment with customer objectives, organization guidelines/benchmarks and industry best practices
• Define and establish structure, process and governance mechanisms for knowledge management and knowledge sharing platforms (e.g., assimilation, classification and dissemination, etc.)
• Create operational artifacts, run-books and service level agreement documents associated with Cloud Data Platform services and products
• Serve as an advisor providing advice and counsel on assignments concerned with specialized or unique engineering requirements
• Participate in the creation of entire systems (e.g., clients, server hardware, network, databases, etc.)
• Provide technical direction and leadership routinely to other engineers; serve as a coach and mentor
• Identify potential problems in design, quality, or operation and initiate corrective action
• Maintain technical expertise in all areas of network and computer hardware and software interconnection and interfacing, such as routers, multiplexers, firewalls, hubs, bridges, gateways, etc.
• Identify opportunities to effectively mitigate risk and improve performance and functionality
• Drive system testing including evaluation, verification & validation activities
• Install, maintain, and configure systems infrastructure on a widely distributed network
• Provide forward thinking technical expertise in current and emerging technologies, trends and practices

• Significant experience in one or more of the following: systems engineering, software engineering, information systems management, etc. at the enterprise level in a large multi-function organization, preferably at a large financial services organization
• Advanced knowledge in the areas of IP internetworking, LAN Switching Protocols (e.g., VLAN (802.1Q), STP, HSRP, VRRP, LACP/PAGP, etc.), IP Routing protocols (IGRP, OSPF, EIGRP, BGP)
• Significant experience with Event driven processing (Confluent Kafka, Precisely CDC, Flink, Ktables and KSQL, Topic and Partitioning strategy, Message delivery guarantees, Producer design, consumer design, streaming,  replication, resiliency,