Senior Data Engineer

Abbott is a global healthcare leader that helps people live more fully at all stages of life. Our portfolio of life-changing technologies spans the spectrum of healthcare, with leading businesses and products in diagnostics, medical devices, nutritionals and branded generic medicines. Our 114,000 colleagues serve people in more than 160 countries.

     

JOB DESCRIPTION:

Meet Lingo, a new biosensing technology that provides users a window into their body. Lingo tracks key biomarkers – such as glucose, ketones, and lactate – to help people make better decisions about their health and nutrition. Biowearable technology will digitize, decentralize and democratize healthcare, enabling consumers to take control of their own health.

At Abbott, you can do work that matters, grow and learn, care for yourself and family, be your true self, and live a full life. You’ll also have access to:

• Career development with an international company where you can grow the career you dream of.

• Employees can qualify for free medical coverage in our Health Investment Plan (HIP) PPO medical plan in the next calendar year

• An excellent retirement savings plan with high employer contribution

• Tuition reimbursement, the Freedom 2 Save student debt program and FreeU education benefit - an affordable and convenient path to getting a bachelor’s degree.

• A company recognized as a great place to work in dozens of countries around the world and named one of the most admired companies in the world by Fortune.

• A company that is recognized as one of the best big companies to work for as well as a best place to work for diversity, working mothers, female executives, and scientists.

The Opportunity

We are seeking a Senior Data Engineer for Lingo based in Alameda, CA (San Francisco Bay Area), our product headquarters.

We are seeking a Senior Data Engineer with deep expertise in Apache Spark to join our team. You will play a critical role in helping us deliver clinically validated, regulatory-grade digital health products and solutions in preventive care using Bio-Wearables. As a senior leader in data engineering, you will help design, develop, and optimize a large-scale real-time data processing system. You will work closely with data analysts, scientists, system designers, and software developers to build scalable data services, pipelines, and interfaces to support our mission. This is a hands-on technical role requiring strong problem-solving skills and deep knowledge of distributed systems.

What You’ll Work On 

• Design, implement, and optimize Apache Spark jobs to define, schedule, monitor, and control data processes.

• Develop, test and deploy algorithms for large-scale machine learning in a production environment.

• Optimize Spark jobs to maximize speed, scalability and compliance with data-use regulations.

• Manage robust data pipelines: acquisition, transformation, and processing workflows.

• Perform advanced data processing and exploratory analysis • Build and deploy machine learning models using Spark or MapReduce, and present results through intuitive visualizations.

• Collaborate with other spark developers and back-end data engineers to design and develop interactive Spark pipelines.

• Develop and maintain REST APIs to manage Spark jobs and facilitate data workflows.

• Ensure seamless integration of pipelines with distributed file and database systems.

Required Qualifications 

• Bachelor's degree in Computer Science, Engineering, or a related field.

• Minimum 6 years of experience in building and optimizing data processing pipelines.

• Expertise in Apache Spark, including Spark SQL, RDD, DataFrame, Dataset APIs, and PySpark.

• Proficiency in programming languages such as Python, and Java (Scala is a plus).

• In-depth understanding of Spark internals and real-time streaming technology (e.g., Kafka, KSQL, etc.)

• Strong experience with big data processing tools (Experience with Apache Druid is a huge plus).

• Familiarity with ETL tools and expertise