Lead Data Engineer

Company

Cox Automotive - USA

Job Family Group

Engineering / Product Development

Job Profile

Lead Data Engineer

Management Level

Manager - Non People Leader

Flexible Work Option

Hybrid - Ability to work remotely part of the week

Travel %

Yes, 15% of the time

Work Shift

Day

Compensation

Compensation includes a base salary of $108,800.00 - $181,400.00. The base salary may vary within the anticipated base pay range based on factors such as the ultimate location of the position and the selected candidate’s knowledge, skills, and abilities. Position may be eligible for additional compensation that may include an incentive program.

Job Description

The Lead Data Engineer is responsible for processing structured and unstructured data, validating data quality, and developing and supporting data products. The Senior Data Engineer also plays a role in Agile planning, providing advice and guidance, and monitoring emerging technologies.
 

WHAT YOU'LL DO

KEY RESPONSIBILITIES:
Process Structured and Unstructured Data

• Gathers and processes raw, structured, semi-structured, and unstructured data using batch and real-time data processing frameworks.

• Understands and enforces appropriate data master management techniques.

Data Validation and Quality

• Ensures data quality and implements tools and frameworks for automating the identification of data quality issues.

• Work with internal and external data providers on data validation providing feedback and making customized changes to data feeds and data mappings.

Agile Planning

• Understands the challenges that the analytics organization faces in their day-to-day work and partner with them to design viable data solutions.

• Recommends improvements to processes, technology, and interfaces that improve the effectiveness of the team and reduce technical debt.

Product Development

• Implements and optimizes data solutions in enterprise data warehouses and big data repositories.

• Installs, maintains, monitors, and supports business intelligence, distributed computation, and big data analytics tools.

Application Support

• Provides ongoing support, monitoring, and maintenance of deployed products.

Advice and Guidance

• Actively works with less experienced data engineers providing technical guidance and oversight.

Emerging Technology Monitoring

• Actively participates in the engineering community, staying up to date on new data technologies and best practices and shares insights with others in the organization.

WHO YOU ARE

QUALIFICATIONS:

• Applicants must currently be authorized to work in the United States for any employer without current or future sponsorship. No OPT, CPT, STEM/OPT or visa sponsorship now or in future.

• Must live within a commutable distance to Atlanta GA

• Bachelor’s degree in Computer Science or related field and 6+ years experience OR Masters Degree w/ 4+ years experience OR 18 years experience of equivalent combination of industry related professional experience and education.

• Must have 4+ years professional experience working as a Data Engineer

• Working experience with batch and real-time data processing frameworks

• Strong working experience with data modelling, data access, schemas, and data storage techniques within Snowflake

• Working experience in design, development, and implementation of highly scalable, high-volume software systems and components, client-facing web applications, and major Internet-oriented applications and systems

• Working experience working with relational databases such as SQL, MySQL, Postgres/PostgreSQL

• Working experience with business intelligence tools and platforms

• Working experience with data quality tools

• Working experience with application lifecycle methodologies (e.g. waterfall, agile, iterative)

• Experience with ETL processes and tools

• Experience working with Git

• Experience or exposure to DBT

• Experience working with AI related tools such as co-pilot

• Experience implementing new tools into environments

PREFERRED QUALIFICATIONS:

• Scrum Developer Certification or equivalent

• Working experience with Sisense platform

• Working experience with SQL Server Integration Services

• Working exper