Principal Data Engineer

Job Requisition ID #

24WD79230

Position Overview

As a Principal Data Engineer, you will build platform capabilities to enhance conversion metrics such as Add to Cart, Trials, Search, and Downloads. Applying Kappa architecture and event stream processing, you will create scalable data solutions. We are looking for advanced technical expertise,, and 8+ years of experience in an enterprise environment.

Minimum Qualifications

• Architect, design, and implement scalable data pipelines using Kappa architecture and event stream processing technologies
• Lead the development of data solutions that directly enhance conversion metrics and improve user experience across digital platforms
• Collaborate with data scientists, product managers, and other team members to define data requirements and ensure data quality and integrity
• Implement real-time data processing and analytics solutions using technologies like Apache Kafka, Apache Flink, Apache Spark, and similar tools
• Use big data frameworks such as Hadoop, HDFS, and Hive for large-scale data processing
• Improve data architecture and processes to support high availability, scalability, and performance
• Mentor senior and junior data engineers, promoting a culture of learning and improvement
• Ensure compliance with enterprise security, performance, and scalability standards in all data engineering projects
• Contribute to the execution of data projects aligned with team goals
• Collaborate with teams to lead enterprise-wide data projects
• Stay updated on the latest trends and best practices in data engineering and event stream processing

Responsibilities

• Successful implementation of scalable data pipelines using Kappa architecture, resulting in improvements in data processing performance
• Development and deployment of real-time data processing solutions that enhance conversion rates and user engagement
• Collaboration with teams to deliver data-driven insights and improvements
• Improve data architecture and processes to ensure high availability, scalability, and performance
• Leadership in guiding and mentoring data engineers, contributing to the team's overall growth.

The Ideal Candidate

• Lead a team of data engineers, encouraging a culture of continuous improvement and new ideas
• Promote the use of best practices in data engineering and event stream processing
• Explore and implement new technologies and methodologies to enhance data processing effectiveness
• Collaborate to align data strategies with team goals and guide data-driven decision- making
• Learn and stay updated on the latest trends and advancements in data engineering
• In identifying and addressing potential areas for improvement in data processes and architecture
• Inspire and guide junior engineers, providing mentorship and support to help them grow in their careers
• Contribute to Autodesk's culture of innovation, striving to shape a better world through high-quality data solutions
• Experience deploying code in AWS, Azure, or Google Cloud environments

Job Title: Principal Data Engineer

Location: San Francisco, California Department: Autodesk Digital Experiences (DXC)

Reports To: Engineering Manager

Learn More

About Autodesk

Welcome to Autodesk! Amazing things are created every day with our software – from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.

 

We take great pride in our culture here at Autodesk – our Culture Code is at the core of everything we do. Our values and ways of working help our people thrive and realize their potential, which leads to even better outcomes for our customers.

 

When you’re an Autodesker, you can be your whole, authentic self and do meaningful work that helps build a better future for all. Ready to shape the world and your future? Join us!

Benefits

From health and financial benefits to time away and everyday wellness, we give Autodeskers the best, so they can do their best work. Learn more about our benefits in the U.S. by visiting https://benefits.autodesk.com/

Salary transparency

Salary is one part of Autodesk’s competitive compensation package. For U.S.-based roles, we expect a starting base salary between $141,400 and $228,800. Offers are based on the candidate’s experience and geographic