Sr Data Engineer
HumanaAbout the role
Become a part of our caring community and help us put health first
We’re seeking a Senior Data Engineer with a strong background in cloud data architecture and hands-on experience working with Azure AI and Speech Services. The ideal candidate will be responsible for designing scalable data pipelines that ingest, transcribe, and transform audio recordings into structured, analytics-ready formats. You will get to play a key role in developing and deploying innovative AI-powered solutions, working with large-scale datasets and cutting-edge tools to solve complex business challenges. You’ll collaborate with data scientists, AI engineers, and product teams to build an end-to-end data solution— from speech-to-text transcription and natural language processing (NLP) pipelines to data modeling and visualization.Architect, build, and maintain ETL/ELT pipelines that process and transform large volumes of structured and unstructured data.
Develop solutions that ingest and transcribe audio files using Azure Speech Services, ensuring accurate transcription, speaker separation, and metadata tagging.
Convert transcripts into structured formats suitable for search, analytics, and ML model training (e.g., JSON, Parquet, or database schemas).
Design, develop, and maintain robust data pipelines for ingestion, processing, and transformation of large datasets.
Assist our data science team in the development and deployment of traditional machine learning models.
Collaborate with data scientists to understand model requirements and translate them into scalable engineering solutions.
Design and manage data lake solutions pertaining to the use case implementations (Data Lake Storage, Databricks Delta).
Automate data workflows and deployments using CI/CD pipelines (Github / Azure DevOps).
Use your skills to make an impact
Required Qualifications:
Bachelor's Degree in engineering or related field (e.g., Computer Science, Software Engineering or a related field) with a minimum of 5 years of professional experience; OR
Master's Degree in a similar field with at least 5 years of relevant experience.
5+ years of experience as a Data Engineer or similar role.
5+ years of Python application development and data manipulation libraries (e.g., Pandas, NumPy).
Familiarity with API frameworks (e.g., FastAPI, Flask) and RESTful API concepts.
Experience working in audio transcription using any of the available services, such as Azure speech services, AWS Transcribe, or Google Speech-to-Text.
3+ years of experience with containerization (e.g., Docker, Kubernetes).
3+ years of experience with CI/CD tools, pipelines, and version control systems (e.g., Azure DevOps, Github)
3+ years of experience with PySpark.
2+ years of experience working on any cloud platform. (Azure / GCP / AWS)
Excellent problem-solving skills and ability to work in a collaborative environment.
Experience working with any nosql DBs. (MongoDB preferred)
Experience working with big data and data streaming technologies (e.g., Hadoop, Spark, kafka).
WAH requirements:
Must have the ability to provide a high-speed DSL or cable modem for a home office. Associates or contractors who live and work from home in the state of California will be provided payment for their internet expense.
A minimum standard speed for optimal performance of 25x10 (25mpbs download x 10mpbs upload) is required.
Satellite and Wireless Internet service is NOT allowed for this role.
A dedicated space lacking ongoing interruptions to protect member PHI / HIPAA information.
Scheduled Weekly Hours
40Pay Range
The compensation range below reflects a good faith estimate of starting base pay for full time (40 hours per week) employment at the time of posting. The pay range may be higher or lower based on geographic location and individual pay will vary based on demonstrated job related skills, knowledge, experience, education, certifications, etc.
Apply for this role
Generate a tailored application kit with a matched cover letter, interview prep, and CV highlights — in under 60 seconds.
Apply Now →Generate Application KitFree account required — sign up in 30s