Lead Infrastructure Databricks Engineer with Kubernetes and AWS

Perficient is a global AI-first consultancy. Our team of strategists, designers, technologists, and engineers partners with the world’s most innovative enterprises and admired brands to deliver real business results through the transformative power of AI. As part of our AI-First strategy, we empower every employee to build AI fluency and actively engage with AI tools to drive innovation and efficiency. We break boundaries, obsess over outcomes, and shape the future for our clients. Join a company where bold ideas and brilliant minds converge to redefine what’s possible - while building a career filled with growth, balance, and purpose.

Perficient currently has a career opportunity for a Lead Infrastructure Databricks Engineer with Kubernetes and AWS to join our team located in the United States. This role is primarily office-based at a local Perficient location, with travel and on-site client engagements expected as needed.

Job Overview

As a Lead Infrastructure Databricks Engineer, you are expected to lead the infrastructure engineering team and have strong experience building and operating large-scale cloud platforms, CI/CD, and ETL platforms associated with Data Lakehouse solutions. You are expected to be experienced and fluent in agile development and agile tools.

The primary focus of this role is on infrastructure and CI/CD activities. You will collaborate with some of the best talent in the industry to create and implement innovative high-quality solutions focused on our clients' business needs.

About Us

The AI Data Platforms-Data & Analytics Services BU supports a wide variety of clients, technologies, and applications. Our Team members drive innovation in the arena of data and analytics solutions. We work on innovative digital transformation deployment for various clients across the globe. We had explosive growth in the last few years to meet the demands of a massive transition to digital with an AI First approach. Our practice groups include Artificial Intelligence, Analytics, Content Management, Data Governance, Data Management, Data Strategy and Search.

Perficient is always looking for the best and brightest talent and we need you! We’re a quickly growing, global digital consulting leader, and we’re transforming the world’s largest enterprises and biggest brands. You’ll work with the latest technologies, expand your skills, and become a part of our global community of talented, diverse, and knowledgeable colleagues.

• Lead the technical planning & requirements gathering phases including estimate, develop, test, manage projects, architect and deliver.
• Serve as a technical lead and mentor.  Provide technical support or leadership in the development and continual improvement of service.
• Develop and maintain effective working relationships with team members.
• Demonstrate the ability to adapt and work with team members of various experience level.

• Deep Technical Expertise: 5+ years building and operating large-scale cloud platforms, with at least 2+ years in a data-focused DevOps/SRE role.
• AWS Implementation Experience: Hands-on experience with AWS services (networking, IAM, security) and proven ability to manage multi-account environments.
• Infrastructure as Code: Strong Terraform skills for multi-stack, multi-environment setups, applying modular design and best practices.
• CI/CD Automation: Demonstrated success in building and optimizing CI/CD pipelines (GitHub Actions, Jenkins) for applications, infrastructure, and data workflows.
• Must have Databricks Expertise: Practical experience with the full Databricks Lakehouse Platform, including Unity Catalog, Delta Lake, and MLflow.
• Kubernetes Operations: Experience administering Kubernetes clusters—deploying workloads via kubectl and Helm, configuring observability, and troubleshooting issues.
• Demonstrated ability to leverage AI tools to enhance productivity, streamline workflows, and support data-informed task execution. 
• Familiarity with AI-enhanced platforms is a plus. 
• A solid understanding of AI capabilities and limitations including ethical considerations is expected.

Nice to Have:

• AWS DevOps or Solutions Architect associate/professional Certification
• Certified Kubernetes Administrator (CKA)
• Terraform Certification

Perficient, Inc. proudly provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation, national origin, age, disability, genetic information, marital status, amnesty, or status as a protected veteran in accordance with applicable federal, state and local laws. Perficient, Inc. complies with applicable state and local laws governing n