Senior Data Engineer

Our client is the leading artificial intelligence solutions provider for enterprise retailers. They are passionate about helping retailers unlock valuable, transformative business insights from their data through their innovative scalable technology.

In the last 5 years, our client has experienced exponential growth having worked with many of today's Fortune 50 retailers, who rely on them for their AI-enabled forecasting, promotion assortment, and allocation solutions.

We are looking for experienced Senior Data Engineers for our client's growing global team!

Requirements

Job Requirements

• Create innovative, scalable, and fault-tolerant solutions
• Design configurable and reusable components for a multi-tenant environment
• Work closely with project and product management, data scientists, and QA in a fast-paced team environment
• Investigate and resolve technical and performance issues
• Experiment, fail-fast, and learn, as you build skills and experience
• Ensure high quality with test automation
• Build, administer and scale data processing pipelines
• Improve scalability, stability, accuracy, speed, and efficiency of our existing data systems
• Support data scientists to make prototypes production-ready
• Ensure high flexibility by implementing microservices in our architecture
• Ensure ways to enhance data quality and reliability

Candidate Requirements

• BS, MS, or PhD in Computer Science
• 5 years of experience as a Data Engineer
• Strong problem-solving and analytical skills
• Comfortable with Scala, Java, and/or other object-oriented programming languages
• A good understanding of the best practices for developing software (version control, CI/CD, automation, pair programming, documentation, testing, …)

Tech Stack:

• Java, Scala, Python (Pyspark), Spark
• Docker, Kubernetes
• Jenkins (CI/CD)
• Azure
• Linux, Shell Scripting
• NoSQL, Cassandra
• Apache Spark and big data analytics

Benefits

• Flexible, diverse work environment
• Respectful, innovative team
• Competitive salary and a progressive bonus while getting startup experience at a company with an awesome culture
• Health insurance
• You get 21 days of Paid Time Off, and major national holidays