Senior-Level Data Engineer

About the company:  At VivSoft, we aim to solve complex federal problems using emerging and open technologies in a collaborative and rewarding environment. VivSoft is a diverse team of strategists, engineers, designers, and creators experienced in building high performance effective softwares, with impactful organizational design and organizational dynamics for software delivery. We build secure Software Factories based on DoD reference designs and NIST Frameworks for Cloud and DevSecOps. These factories deliver AI/ML Applications, Data Science Platforms, Blockchain and Microservices for DoD, Healthcare and Civilian AgenciesJob Summary:The Senior-Level Data Engineer will be a critical member of the DoD team, responsible for designing, building, and maintaining robust data pipelines and architectures that support advanced analytics and artificial intelligence initiatives across the Department of Defense (DoD). This role will focus on optimizing data flows, ensuring data quality, and integrating various data sources to facilitate effective decision-making. 

Key Responsibilities

• Data Pipeline Development: Design and implement scalable data pipelines to ingest, process, and store large volumes of structured and unstructured data from diverse sources. 
• Data Architecture Design: Develop and maintain data architecture strategies that align with the DoD’s objectives and support the Advana platform's capabilities. 
• Collaboration: Work closely with data scientists, analysts, and software engineers to ensure seamless integration of data solutions into AI/ML applications and analytics tools. 
• Data Quality Assurance: Implement data quality checks and validation processes to ensure the accuracy and reliability of data used in analytics and reporting. 
• Performance Optimization: Monitor and optimize data processing workflows for efficiency and performance, employing best practices in ETL (Extract, Transform, Load) processes. 

Skills/Qualifications Reqd

• Clearance Requirements: Active Top Secret (TS) clearance with Sensitive Compartmented Information (SCI) eligibility  
• Education: Bachelor’s degree in computer science, Data Engineering, Information Technology, or a related field; master’s degree preferred. 
• Minimum of 5 years of experience in data engineering or a related field with a focus on building data pipelines and architectures. 
• Proven experience with big data technologies such as Apache Spark, Hadoop, or similar frameworks. 
• Familiarity with cloud platforms (e.g., AWS, Azure) for data storage and processing is advantageous. 
• Proficiency in programming languages such as Python, Java, or Scala; experience with SQL for database management. 
• Strong understanding of data modeling concepts and best practices for managing large datasets. 
• Excellent problem-solving skills with the ability to analyze complex data issues.