Senior Manager, Data Engineering

Overview

About the Role & Team

 

Senior Manager of Data Engineering 

 

IDC is seeking a highly skilled and motivated Senior Manager of Data Engineering & Advanced Analytics to lead the design, development, and scaling of advanced data-driven products. This role combines strong team leadership with deep hands-on expertise in data engineering, data management, and data modeling, along with a strong emphasis on advanced analytics, machine learning, and AI-driven solutions.

 

You will be responsible for building and leading a high-performing team while architecting and delivering scalable data platforms and intelligent data products. Working across large and complex datasets, modern data technologies, and cross-functional teams, you will play a key role in advancing IDC’s market intelligence and vendor data capabilities.

 

This is a senior leadership role for an experienced professional who can drive technical strategy, mentor teams, and remain actively engaged in solution design, data modeling, and advanced analytical methods.

What You’ll Do

• Lead and develop a team of data engineers and advanced analytics professionals, fostering a culture of technical excellence and continuous improvement.
• Design and deliver machine learning, AI, and advanced analytical solutions, including predictive modeling, forecasting, and complex data-driven use cases.
• Architect and implement robust data management and data modeling frameworks to support scalable, high-quality analytics and AI applications.
• Build and optimize data pipelines and workflows using Python, SQL, Snowflake, and AWS for data ingestion, transformation, and delivery.
• Apply statistical, mathematical, and algorithmic techniques to solve complex business problems and generate actionable insights.
• Prototype, test, and deploy end-to-end analytical and data solutions, from data engineering through to production deployment.
• Develop tools and applications in Python for data processing, automation, and advanced modeling.
• Create interactive dashboards and applications to enable data exploration and reporting.
• Design and implement graph analytics, entity resolution, and semantic search capabilities.
• Collaborate with global teams across engineering, product, and research to deliver high-impact solutions.
• Provide technical leadership, define best practices, and guide architectural decisions across data and analytics domains.

 

What You Bring

• BA/BS in Computer Science, Mathematics, Statistics, Data Engineering, or a related field; or equivalent experience (5+ years).
• 5+ years of experience in data engineering, advanced analytics, machine learning, or related technical roles.
• Proven experience in team leadership and people management, including mentoring and leading complex technical initiatives.
• Strong expertise in data management, data modeling, and scalable data architecture.
• Advanced proficiency in Python and SQL, with experience in Snowflake or similar database platforms.
• Hands-on experience with AWS (data services, storage, compute, or analytics stack).
• Demonstrated experience designing and deploying machine learning models and advanced analytical solutions in production.
• Strong grounding in statistical analysis, predictive modeling, and algorithm development.
• Familiarity with Generative AI, Large Language Models (LLMs), and modern AI frameworks.
• Excellent problem-solving, communication, and stakeholder engagement skills.

Nice to Have:

• Experience with AI tools, Generative AI, and Large Language Models (LLMs).
• Experience building data quality frameworks, anomaly detection, and outlier detection solutions.
• Familiarity with modern AI frameworks and experimentation workflows.

 

Why This Role Stands Out At IDC, your work helps shape how the world understands technology and where it goes next. You collaborate with curious, high-caliber colleagues who value rigor, integrity, and shared success. As the premier global provider of trusted technology intelligence, IDC equips business and technology leaders with the evidence they need to make confident decisions. Our insights inform strategy, investment, and innovation across industries and regions.

 Recognized by IIAR as Analyst Firm of the Year for five consecutive years, IDC sets the standard for credibility and impact. With more than 1,000 analysts worldwide and a truly global perspective, we combine deep expertise with practical relevance. Here, your ideas matte