Sr. Data Engineer

Position Summary:

The Big Data Engineer is responsible for expanding and optimizing the data and data flow architecture for the company’s business intelligence ecosystem. This role will support the team’s business intelligence initiatives by provisioning necessary data across a variety of data sources and ensuring optimal data delivery for consumption within the company’s business intelligence platform. This role will be responsible for designing, constructing, and supporting a scalable business intelligence data platform, including appropriate data governance & management processes and tools. The right candidate will be excited by the prospect of optimizing or even re-designing the company’s data architecture to support ongoing and future products and data initiatives.

Primary Accountabilities:

• Data Engineering

  • Design, construct, test, and maintain an optimal data pipeline architecture for company’s business intelligence ecosystem.

  • Assemble large, complex data sets from a variety of sources into functional business schemas that can be leveraged by business intelligence developers, data scientists, and company business/data analysts.

  • Identify, design, and implement internal data process improvements (e.g. automating manual processes, optimizing data delivery, re-designing processes for greater scalability)

  • Collaborate with business stakeholders, team members, and customers to assist with data-related technical issues and support their data infrastructure needs.

  • Collaborate with Software Engineering, Data Management, and Server/NetSec teams to procure and maintain necessary business intelligence platform infrastructure.

  • Work effectively in a self-organizing team that supports multiple business units and products.

  • Participate in prioritization and grooming sessions with business stakeholders.

  • Maintain in-depth knowledge of supported company products and offerings, including associated databases and other data sources.

Qualifications:

• Education: Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field

• 5+ years of experience in data engineering, with expertise in SQL, BigQuery, and GCP.

• Strong experience with Apache Iceberg, Starburst, and Trino for large-scale data processing.

• Proven track record of designing and optimizing ETL/ELT pipelines and cloud-based data workflows.​​​

Technical Skills:

• Proficiency in SQL, including query optimization and performance tuning.
• Experience working with BigQuery, Google Cloud Storage (GCS), and GCP data services.
• Knowledge of data lakehouse architectures, data warehousing, and distributed query engines.
• Hands-on experience with Apache Iceberg for managing large-scale transactional datasets.
• Expertise in Starburst and Trino for federated queries and cross-platform data access.
• Familiarity with Python, Java, or Scala for data pipeline development.
• Experience with Terraform, Kubernetes, or Airflow for data pipeline automation and orchestration.

Preferred Skills:

• Understanding of machine learning data pipelines and real-time data processing.

• Experience with Looker for data modeling and visualization

• Experience with data governance, security, and compliance best practices.

• Exposure to Kafka, Pub/Sub, or other streaming data technologies.

• Familiarity with CI/CD pipelines for data workflows and infrastructure-as-code

Individual Competencies:

• Analytical and Critical Thinking: Ability to tackle a problem by using a logical, systematic, sequential approach.
• Problem Solving: Gathers and analyzes information to generate and evaluate potential solutions to problems, issues and challenges while weighing the accuracy and relevance of the facts, data and information.
• Intellectual Curiosity: Exploring new and unique ways to solve business intelligence data pipeline and platform opportunities. Thinking ahead and planning for the future through innovative exploration and experimentation.
• The physical demands described here are representative of those that