Data Engineer

We are the movers of the world and the makers of the future. We get up every day, roll up our sleeves and build a better world -- together. At Ford, we’re all a part of something bigger than ourselves. Are you ready to change the way the world moves? 

Global Data Insight & Analytics (GDI&A) aspire to navigate Ford Motor Company through the disruptiveness of the information age, harnessing the power of data and artificial intelligence to realize the enterprise’s known goals, reveal hidden opportunities, and achieve data superiority.

The GDI&A Data Factory (DF) covers all business processes and technical components involved in ingesting a wide range of enterprise data into the GDIA Data Factory and the transformation of that data into consumable data sets and APIs in support of analytics. Data is a critical enabler to achieving our Smart Vehicles in a Smart World aspiration; it is the fuel for AI/ML, Customer Experience, Fitness, and Innovation.  

Within GDIA Data Factory, there is a phenomenal opportunity awaits on a team that is responsible for ingesting connected vehicle data streams that integrate with internal Ford systems shaping the future of vehicles.

Connected Vehicle Data Team is a product line that delivers a scalable and extensible test-and-learn ecosystem that focuses on new advanced opportunities. The ecosystem is an integrated, multi-platform solution that incorporates on-prem technology, and Ford’s next-generation cloud technologies. This position is a great opportunity to drive the Connected Vehicle Data delivery, which will bring to production many key strategic capabilities.

What you'll do...

You will be responsible for developing scalable big data pipeline solutions in the Ford GCP Data Factory. 

Advanced knowledge of the GCP ecosystem with a focus on Big Query and Dataflow.

Designing and coding Big Query to ingest data collections 

Analyze user needs to determine how software should be built or if existing software should be modified.

Participate in design, delivery estimates and code reviews

Develop and/or perform software automated testing procedures, solutions, and frameworks to ensure software functions as needed

Translate business requirements and specifications into usable and scalable software

Process and understand capabilities and limitations of data outputs from the software

Understand and assist with the technical infrastructure of an application or system

Determine and execute the software deployment process and troubleshoot performance issues.

Develop data quality and validation routines

Build distributed reliable and scalable data pipelines to ingest and process data in real-time and other unstructured data.

Build data model, data flow diagrams, design test cases, and own development tasks for assigned products

You'll have... 

Bachelor’s degree in Computer Science, Computer Engineering, Information Technology, or equivalent experience

7+ years of work experience in software development skill set

5 + years Expertise in Java

3+ years real time streaming including Kafka and/or pub/sub

2+ year of experience with the following:

GCP Cloud data implementation projects experience (ApacheBeam, SpringBoot, Dataflow, Airflow, BigQuery, Cloud Storage, Cloud Build, Cloud Run, etc.)

In depth understanding of Apache Beam or Spring boot framework

Working knowledge of Agile methodologies

 

Even better, you may have...

2+ years experience with high volume, real time telemetry data

Ability to write complex SQL queries needed to query & analyze data

Ability to communicate complex solution concepts in simple terms

Ability to apply multiple solutions to business problems

Ability to quickly comprehend the functions and capabilities of new technologies.

Exceptional software engineering knowledge and the ability to mentor junior software developers

Relevant experience with database(MSSQL, SQL Server, BigQuery etc)

Data design, data architecture and data modeling (both transactional and analytic)

Knowledge of test driven development practices

Analyze user needs to determine how software should be built or if existing software should be modified

Using Microservices to help with scalability of production code through APIs

Develop and/or perform software automated testing procedures, solutions and frameworks to ensure software functions as needed

Highly effective in working with other technical experts, Product Managers, UI/UX Designers and business stakeholders

Capable in Continuous Integration/Continuous Delivery tools and pipelines such as Jenkins, Maven, Gradle, GitHub, etc.

Translate business requirements and specifications into usable and scal