Data Engineer

We're seeking an experienced Data Engineer to design, develop, and maintain robust data pipelines and infrastructure for Acelab – B2B marketplace that connects architects and designers with building material manufacturers. This role will be crucial in managing our data ecosystem, implementing advanced analytics, and supporting our data science and engineering teams in delivering high-quality insights and products.

Key Responsibilities:

• Design, develop, and maintain pipelines for importing and cleaning semi-structured data from various sources
• Specify, deploy, and manage scalable and reliable data pipeline infrastructure
• Design and implement database schemas to efficiently store and retrieve complex and sparse data
• Collaborate closely with data science and engineering teams to reconcile datasets and ensure data consistency across systems
• Develop and maintain data quality checks and monitoring systems
• Optimize data storage and retrieval processes for improved performance and cost-effectiveness
• Participate in code reviews and contribute to best practices for data engineering
• Stay up-to-date with the latest trends and technologies in data engineering and big data processing

Requirements

• Ideal fit would be someone with experience in data-intensive industries such as e-commerce (e.g., Wayfair, Amazon, Shopify) or similar high-volume data environments
• Bachelor's or Master's degree in Computer Science, Data Science, or a related field
• 3+ years of experience in data engineering or a similar role
• Strong proficiency in SQL, and at least one big data processing framework (e.g., Apache Spark, Hadoop)
• Some experience with .NET Web API
• Experience with cloud platforms (AWS, Azure, or GCP) and their data services
• Solid understanding of data modeling, ETL processes, and data warehousing concepts
• Familiarity with version control systems (e.g., Git) and CI/CD practices
• Knowledge of data governance and security best practices
• Strong problem-solving skills and attention to detail
• Excellent communication skills and ability to work in a collaborative environment
• Experience with Agile development methodologies

Benefits

• Work with some of the brightest minds in AEC, including former CEO of Revit
• Unlimited PTO, Sick Days, Paid National Holidays, and more
• Medical, dental, vision, short-term/long-term disability plans, and 401(k)
• Opportunities for growth, creativity, and ownership
• Flexible and remote work schedules