Lead Data Engineer

Job Description Summary

Develops and implements specialized code supporting the interfaces between an organization's business application systems and a data warehouse.

Job Description

This position follows our hybrid-friendly schedule, so you get the best of both worlds – flexibility and collaboration. In office days will be 2-3 per week averaging 10-12 days per month in our St Petersburg, FL Corporate Office.
 

Responsibilities:

• Design, implement, and evolve robust and effectively aligned architecture solutions that operate in the business ecosystem.

• Approve database specifications, ensuring all agreed standards and protocols are followed and data integrity is preserved.

• Install and test the most complex databases and associated products to ensure they are suitable for use and meet customer requirements.

• Design and select business-critical storage, data center, and client/server environments to design solutions in line with industry best practice and provide a third-line point of escalation for appropriate global infrastructure solutions.

• Lead in detecting and analyzing security incidents, including attacks, breaches, and identified vulnerabilities, and remediate any security gaps in line with the security incident management procedure.

• Create and maintain technical and/or user documentation to a high standard, and back up files to ensure instant recovery if problems occur.

• Discuss and recommend more complex or innovative technical developments to improve the quality of the website/portal/application software and supporting infrastructure to better meet users’ needs.

• Develop own capabilities by participating in assessment and development planning activities as well as formal and informal training and coaching; gain or maintain external professional accreditation, where relevant, to improve performance and fulfill personal potential. Maintain an in-depth understanding of technology, external regulation, and industry best practices through ongoing education, attending conferences, and reading specialist media.

• Explore and develop a detailed understanding of external developments or emerging issues and evaluate their potential impact on, or usefulness to, the organization.

• Design and monitor the quality of website/applications software tests and respond to user emails to monitor, diagnose, and correct performance issues.

• Develop existing and new applications by analyzing and identifying areas for modification and improvement. Develop new applications to meet customer requirements.

• Design and plan fault isolation and resolution for complex challenges to limit and address issues promptly.

Technical Skills/Experience:

• Expert-level experience with relational databases like Oracle.

• Expert-level experience in performance optimization of ETL and databases is required.

• Expert experience with ETL/ Data Flow Principles. Extracting and loading data from source systems is required.

• Expert-level understanding of various data integration patters/technologies is a must.

• Experience developing end-to-end low-latency data pipelines is required.

• Experience with SQL, PL/SQL modules such as packages, procedures, functions, and other database objects is required.

• Experience with any major ETL tools like ODI, Informatica, DataStage is required.

• Experience with Unix and Shell scripting.

• Experience with job scheduler tools like BMC Control-M, Autosys.

• Experience with streaming technologies like Kafka is a great plus.

• Experience with Graph databases like Neo4j is a great plus.

• Experience with a programming language like Python is a great plus.

• Experience with cloud technologies like AWS is a great plus.

• Financial services and/or enterprise-level experience is a plus.

• Knowledge of Java or REST API.

• Ability to work independently with minimum supervision and experience to guide and mentor junior team members

• Excellent verbal and written communication skills including stakeholder management

• Experience developing AI-driven applications is a