Senior Staff Software Engineer - Lakehouse Apps

P-1069

Summary

At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best data and AI infrastructure platform, so our customers can focus on the high-value challenges that are central to their missions.

Founded in 2013 by the original creators of Apache Spark, Databricks has grown from a tiny corner office in Berkeley, CA to a global organization with over 5000 employees. Thousands of organizations, from small to Fortune 100, trust Databricks with their mission-critical workloads, making us one of the fastest-growing SaaS companies in the world.

Our engineering teams build highly technical products that fulfill real, important needs in the world. We constantly push the boundaries of data and AI technology, while simultaneously operating with the resilience, security, and scale that is critical to making customers successful on our platform.Customers trust Databricks with their most valuable data and the Data Intelligence Platform Governance org has the mission to build the most trusted data analytics and ML platform in the world. We are pursuing an exciting new product opportunity to host first- and third- party data applications on Databricks. We are looking for senior leaders such as yourselves to create and drive the security & platform roadmap so we can scale and securely operate complex third-party data applications and build a thriving partner ecosystem on Databricks with thousands of curated applications. 

In this role, you will lead all aspects of making Apps a first class entity on the Databricks platform. You will drive the technical strategy to identify, prioritize and deliver both the external and internal controls necessary for customers to meet their privacy, confidentiality, data sovereignty and other regulatory obligations. You will create technical safeguards that allow us to sandbox apps and keep customer data safe. Your work will help IT and security administrators feel at ease with enabling third-party apps on Databricks for users in their organization. You will report to a Senior Director of Engineering.

Role and Responsibilities:

As a software engineer in the Lakehouse Apps team, you are responsible for designing, implementing, and maintaining the platform for hosting first- and third-party applications. In this role, you will:

• Work closely with customers and product managers to understand and prioritize platform requirements.
• Write detailed technical specifications that will meet the product and non-functional requirements such as security, performance, and observability.
• Collaborate closely with senior engineers across the company to drive platform capabilities needed to support Lakehouse apps such as compute scaling, egress controls, and GPU support.
• Be the ultimate owner and technical lead for a team of software engineers and drive execution of the project, breaking the work into meaningful milestones, maintain code quality standards, and build some of the complex parts of the infrastructure to support apps.
• Use your deep experience to help prevent and investigate production issues.

Minimum Requirements:

• Masters in Computer Science or equivalent
• 8+ years of experiences, especially building and operating large scale distributed systems 
• Proficiency in one more programming languages such as C++, Java, Scala 
• Deep systems knowledge and expertise in concurrency and asynchronous programming 
• Fairly hands on and comfortable in a fast paced environment
• Experience with kubernetes is a plus
• Experience building and scaling developer platform is a huge plus

Benefits

• Comprehensive health coverage including medical, dental, and vision
• 401(k) Plan
• Equity awards
• Flexible time off
• Paid parental leave
• Family Planning
• Gym reimbursement
• Annual personal development fund
• Work headphones reimbursement
• Employee Assistance Program (EAP)
• Business travel accident insurance
• Mental wellness resources

 

Pay Range Transparency

Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents base salary range for non-commissionable roles or on-target earnings for commissionable roles.  Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks utilizes the full width of the range. The to