Cloud Data Engineer

The Cloud Data Engineer is part of a Data Management team that is responsible for modernizing and transforming our data and reporting capabilities across our products by implementing a new modernized data architecture. The position will be responsible for day-to-day data collection, transportation, maintenance/curation, and access to the GovX corporate data asset. The Cloud Data Engineer will work cross-functionally across the enterprise to centralize data and standardize it for use by business reporting, machine learning, data science or other stakeholders. This position plays a critical role in increasing the awareness about available data and democratizing access to it across GovX and our data partners.

This position will be under the supervision of the Chief Technology Officer.

RESPONSIBILITIES

• Crafting and maintaining efficient data pipeline architecture.
• Assembling large, complex data sets that meet functional / non-functional business requirements.
• Design and maintain schemas.
• Create and maintain optimal data pipeline/flow architecture.
• Identifying, crafting, and implementing internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Working with technical and non-technical stakeholders to assist with data-related technical issues and support their data infrastructure needs.
• Working with the team to strive for clean and meaningful data, and greater functionality and flexibility within the team’s data systems.
• Design processes supporting data transformation, data structures, metadata, dependency, and workload management.

Requirements

• Advanced working knowledge of SQL and NoSQL query authoring.
• Experience working with streams such as Event Hubs and Event Driven Architectures.
• Experience with Microsoft Fabric, Power Platform including Power BI and Power Apps.
• Proficiency with object-oriented/object function scripting languages: Python, C#, etc.
• Experience with big data tools: Spark, etc.
• Experience building, maintaining, and optimizing ‘big data’ data pipelines, architectures, and data sets.
• Experience cleaning, testing, and evaluating data quality from a wide variety of ingestible data sources.
• Strong project management, communication, and organizational skills.

Supervisory Responsibilities
This position has no supervisory responsibilities. This position provides oversight and mentoring.

Work Environment
This job operates in a professional office environment. This role routinely uses standard office equipment such as computers, phones, photocopiers, filing cabinets and fax machines. This role occasionally must lift and carry the office equipment.

Work Location
Due to state law and tax implications, remote work candidates must live and work in one of the following states: California, Oregon, Washington, Texas, Tennessee, Florida, or New York.

• Physical - This is largely a sedentary role.
• Mental – Problem solving, making decisions, interpret data, organize, read/write.
• Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

Travel
No travel is expected for this position.

Preferred Education and Experience

• Bachelor’s degree or equivalent experience.
• 4+ years of proven experience deploying and maintaining always-on data services.
• 2+ years in building data engineering pipelines in Azure (ADF, Databricks, or Synapse).
• 2+ years in cloud data engineering experience in Azure.
• 2+ years of experience with SQL Server.

Other Duties

Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job. Duties, responsibilities and activities may change at any time with or without notice.

Benefits

• Work for a company with a greater social mission. We work to serve those who serve our country and communities every day.
• No boring days. This is a fast-paced environment where you will learn a lot and have the direct ability to leave your mark on a growing e-commerce company.
• Remote-first work environment with modern San Diego HQ office that is available as needed.
• Flexible paid time off, paid holidays and sick leave.
• Competitive insurance benefits to include: Me