Director, Data Engineering (Databricks Platform)

Job Summary:

WHO ARE WE?

Live Nation Entertainment is the world’s leading live entertainment and eCommerce company, comprised of four market leaders: Ticketmaster.com, Live Nation Concerts, Front Line Management Group and Live Nation Network.  Ticketmaster.com is the global event ticketing leader and one of the world’s top five eCommerce sites, with over 26 million monthly unique visitors.  Live Nation Concerts produces over 20,000 shows annually for more than 2,000 artists globally.  Front Line is the world’s top artist management company, representing over 250 artists.  These businesses power Live Nation Network, the leading provider of entertainment marketing solutions, enabling over 800 advertisers to tap into the 200 million consumers Live Nation delivers annually through its live event and digital platforms. For additional information, visit www.livenation.com/investors.

WHO ARE YOU?

Passionate and motivated. Driven, with an entrepreneurial spirit. Resourceful, innovative, forward thinking and committed. At Live Nation Entertainment, our people embrace these qualities, so if this sounds like you then please read on! 

THE TEAM

Core Data Services team is at the center of Data and Analytics initiatives. We are building a modern data platform to support enterprise data needs. Our mission and yours too should you choose to join us, is to empower and enable our data community of data engineers, data scientists, analysts, product teams and decision makers to create value.

We are building a highly functional, performant modern enterprise Data Lake while supporting our current data platforms. We focus on creating trusted, usable data assets in an environment that enables LNE teams to drive value for fans and our business. This is what defines us as a Core Data Services Team.

THE ROLE

We are seeking an experienced and visionary Director of Data Engineering for the Platform Tools and Services to lead our efforts in advancing the capabilities and functionalities of our data platform. In this role, you will be responsible for defining the strategic direction, overseeing the development of tools and services for data ingestion and driving the adoption of Databricks platform within our organization. As a key leader, you will collaborate cross-functionally with engineering, product management, and customer success teams to ensure the success of our data platform services initiatives.

WHAT THIS ROLE WILL DO

• Define and execute a comprehensive strategy for the enhancement and expansion of Data Platform tools and services, aligned with the company's overall goals and market trends
• Lead a team of data engineers and software engineers and collaborate closely with cross-functional teams to ensure the successful delivery of scalable and efficient data ingestion services and common tools
• Build tools to monitor job run status, data quality and SLA thresholds
• Manage cross-team dependencies and work with tech leads on solutions
• Encourages a culture of team-driven decision-making, ownership and accountability
• Develop solid understanding of Databricks Unified Platform
• Manage and mentor a team of data platform engineers, fostering a culture of collaboration, innovation, and continuous learning
• Set performance expectations, conduct regular performance evaluations, and provide feedback to team members
• Identify skills gaps and training needs within the team and develop appropriate development plans
• Foster a diverse and inclusive work environment, ensuring equal opportunities for all team members
• Oversee the design, development, and maintenance of scalable data engineering infrastructure, ensuring optimal performance and reliability
• Drive the implementation of efficient data processing pipelines and workflows to support analytics, reporting, and machine learning initiatives

WHAT THIS PERSON WILL BRING

• Proven experience (10+ years) in software engineering, data engineering, with a strong emphasis on managing complex API development and data ingestion.
• Strong experience in Spark, Python, cloud databases, and ETL is required.
• Expert in developing scalable and efficient data pipelines using PySpark.
• Databricks experience is highly preferred.
• Good experience in full stack development including react UI development and developing backend services for data ingestion is preferred.
• Highly knowledgeable in selecting strong tools and technology stacks for data ingestion process
• Strong leadership and management skills, as well as experience leading and developing high-performing teams.
• Requires a deep