Senior, Data Engineer

Position Summary...

What you'll do...

Are you a dynamic leader with a passion for innovation and collaboration? Join us as a Senior, Data Engineer and guide small teams, including offshore associates, through complex projects. You'll drive the execution of business plans, craft technical solutions, and ensure timely delivery. Your role will include overseeing engineering solutions from design to implementation, managing project timelines, and enhancing designs to prevent defects. Embrace this opportunity to champion our values, promote ethical practices, and support community outreach. 

About Team:

The Data Sharing & Collab Team helps Suppliers to ingest data in lowest granularity with ease of adoption and always on par with latest tech stats exploration like Deltashare, Databricks, Snowflake etc. This team will help to grow adoption as the tech expert and share visibility on the product value add. 

What You Will Do:

• Assist in designing and implementing high-performance data pipelines and ETL processes for large-scale advertising data.
• Develop and maintain data infrastructure and platforms using open-source technologies, ensuring scalability, reliability, and security.
• Collaborate with data scientists to build and deploy machine learning models that generate insights and recommendations for optimizing advertising campaigns.
• Work closely with stakeholders to understand business requirements and translate them into technical solutions.
• Champion data quality, governance, and best practices across the organization.
• Stay abreast of industry trends and emerging technologies, identifying opportunities to enhance our data and analytical capabilities.
• Contribute to the development and evolution of our data strategy and roadmap.
• Evangelize an extremely high standard of code quality, system reliability, and performance  
• Ability to write designs for data architecture of data warehouse or data lake solutions or end to end pipelines Expert in data architecture principles, distributed computing Intake prioritization, cost/benefit analysis, decision making of what to pursue across a wide base of users/stakeholders and across products, databases and services
• Exceptional communication skills, with the ability to communicate complex technical solutions and ideas to both technical and non-technical team members
• Ability to lead our technical relationship with partners and mentor senior software developers in multiple initiatives

What You Will Bring:

• 5+ years of data engineering experience
• Deep understanding of data warehousing concepts, dimensional modeling, and ETL best practices.
• Strong proficiency in SQL and at least one scripting language like Scala, and Python.
• Hands-on experience with open-source big data technologies such as Hadoop, Spark, Kafka, and Hive.
• Proven track record coding with at least one programming language e.g.,Scala (preferred), Python Expert in cloud computing platforms and offerings from Google Cloud Platform (GCP) (preferred), Microsoft Azure.
• Experience with the integration tools like Automic,  or Airflow,
• Skilled in data modeling & data migration protocols  
• Extensive working knowledge of CI/CD pipelines
• Experience with cloud platforms, including their data storage, processing, and analytics s