Senior, Data Engineer (AdTech)

Position Summary...

What you'll do...

As a Sam's Club Tech - Senior Data Engineer, you will dig into our mammoth scale of data to help unleash the power of retail data science by imagining, developing, and maintaining data pipelines that our Data Scientists and Analysts can rely on.  You will be responsible for contributing to an orchestration layer of complex data transformations, refining raw data from source into targeted, valuable data assets for consumption in a governed way. You will partner with Data Scientists, Analysts, other engineers, and business stakeholders to solve complex and exciting challenges so that we can build out capabilities that evolve the retail business model while making a positive impact on customer’s lives.

About Team:
Sam's Club is our membership warehouse club, a business model that provides our members with high-quality products at prices that are unrivaled by traditional retail. Sam's Club provides a carefully curated assortment of items, as well as developing and leading technologies and services such as Scan & Go, Club Pickup, and home delivery service in select markets. Sam's Club also provides travel, auto purchasing, pharmacy, optical, hearing aid centers, tire and battery centers, and a portfolio of business operations support services.

What you'll do:  

• Consolidate and standardize all connections to external systems and programmatic exchanges. (DFP/GAM, ANX, TTD, LiveIntent, Adobe, Pinterest, LiveRamp etc)
• Provide a unified create/read/update/delete API for operations across all of the third-party systems
• Provide a normalized view of campaigns and metrics from these different sources for other systems to use.
• Generate insights and reports for advertiser campaigns in both real-time and batch mode
• Collect and aggregate ad delivery metrics (real-time impression, viewability etc.).
• Partner with DS to build and enhance sales lift methodologies, including synthetic control, ghost ads etc.
• Build and operate a data warehouse for analytics and business operations
• Expose all reports via reporting APIs and data tables
• Collaborate with engineering and infra teams to build a ML and experimentation platform
• Ownership of ML models for audience targeting. Build and improve relevance and ranking models for ad serving
• Ownership of lift measurement methodology, and support enhancement of attribution models and buyer analytics

What you'll bring:

• 6 - 8 years of Big Data development experience
• 2 - 3 Years of Experience in GCP/Azure cloud platforms
• 2 - 3 years of experience building streaming pipeline using spark streaming or similar.
• Demonstrates up-to-date expertise in Data Engineering, complex data pipeline development.
• Architect, Design, develop, implement, and tune distributed data processing pipelines that process large volume of data; focusing on scalability, low -latency, and fault-tolerance in every system built.
• Exposure to Data Governance (Data Quality, Metadata Management, Security, etc.) 
• Experience with Java, Scala and/or Python to write data pipelines and data processing layers
• Demonstrates expertise in writing complex, highly optimized queries across large data sets
• Proven working expertise with Big Data Technologies Spark Scala/PySpark, and SQL
• Knowledge and e