Senior Data Engineer (Scala)
ICFAbout the role
**This role can be completely remote, sitting anywhere within the US**
We seek a talented Senior Data Engineer who is eager to apply computer science, software engineering, databases, and distributed/parallel processing frameworks to prepare big data for the use of data analysts and data scientists. If you have experience with Scala and Spark and want your work to contribute to systems that utilize healthcare data to improve the quality and cost of healthcare to millions of patients nationwide.
You will work on projects that support the Centers for Medicare and Medicaid Services (CMS) as we develop cost measures and reports that directly impact healthcare quality. You will use Spark to build data processing pipelines that derive information from large sets of government data. Scala coding of measures pipelines that produce measure results derived from claims data and reports to clinicians detailing the data used in the measures.
Tools & Technology:
- Spark, Hadoop, Scala, Python, and AWS EMR
- Airflow, Jenkins
- AWS Redshift and Teradata
- Git and Github
- Confluence
Key Responsibilities:
- Write complex unit and integration tests for all data processing code
- Work with DevOps engineers on CI, CD, and IaC
- Read specs and translate them into test designs and test automation
- Perform code reviews and develop processes for improving code quality
Basic Qualifications:
- Bachelor’s Degree
- 5+ years of high volume experience with Scala, Spark, the Spark Engine, and the Spark Dataset API
- 2+ years of experience with Agile methodology
- 2+ years of experience performing data pipeline and data validation
- Must live in the United States, have lived in the US for 3 of the last 5 years, and be able to obtain a Public Trust Clearance.
Preferred Qualifications:
- MS and 3+ years of technical experience
- Experience working in the healthcare industry with PHI/PII
- Federal Government contracting work experience
- Expertise working as part of a dynamic, interactive Agile team
- Strong written and verbal communication skills
- Demonstrated time management skills.
- Strong organizational skills with attention to detail
- Curiosity about how things work, ability to look out for potential risks
Working at ICF
ICF is a global advisory and technology services provider, but we’re not your typical consultants. We combine unmatched expertise with cutting-edge technology to help clients solve their most complex challenges, navigate change, and shape the future.We can only solve the world's toughest challenges by building a workplace that allows everyone to thrive. We are an equal opportunity employer. Together, our employees are empowered to share their expertise and collaborate with others to achieve personal and professional goals. For more information, please read our EEO policy.
Reasonable Accommodations are available, including, but not limited to, for disabled veterans, individuals with disabilities, and individuals with sincerely held religious beliefs, in all phases of the application and employment process. To request an accommodation, please email Candidateaccommodation@icf.com and we will be happy to assist. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.
Read more about workplace discrimination rights or our benefit offerings which are included in the Transparency in (Benefits) Coverage
Apply for this role
Generate a tailored application kit with a matched cover letter, interview prep, and CV highlights — in under 60 seconds.
Apply Now →Generate Application KitFree account required — sign up in 30s