Senior Big Data Engineer

At Definitive Healthcare, our passion is to transform data, analytics and expertise into healthcare commercial intelligence. We help clients uncover the right markets, opportunities and people, so they can shape tomorrow’s healthcare industry. Our SaaS platform creates new paths to commercial success in the healthcare market, so companies can identify where to go next.  

Our employees are kind, collaborative, energetic, approachable and driven. On top of that, we value the unique perspectives, backgrounds and voices of our employees. Why? Because their diverse experiences drive new ideas and help us build a better community. 

For over 10 years, we’ve built a collaborative culture driven by employees who share a passion for improving the healthcare ecosystem, enjoy giving back to the local community and value diversity and inclusion.  

One of the hallmarks of our culture is our commitment to community service. Through the DefinitiveCares program, employees can work with their choice of more than 40 charitable organizations, supporting causes from hunger and homelessness to healthcare, LGBTQ+ issues, racial justice, women’s initiatives and more. 2021 marked the sixth year that we had 100% employee participation in DefinitiveCares. 

We also provide a range of opportunities for employees to connect with each other. Employees can join any of our employee run affinity groups supporting causes such as women’s empowerment, LGBTQ+, Black, indigenous and people of color (BIPOC), disabilities and working parents and potential for many more. Affinity groups often enable greater education companywide through training, events and speaker series. 

We’re also a great place to work. For five years in a row, we’ve been recognized by the Boston Business Journal and the Boston Globe as a best place to work in Massachusetts. In 2022, Energage recognized us for Culture Excellence in Compensation & Benefits, Innovation, Great Leadership, Purpose & Value and Work-Life Flexibility! 

Think you’d be a good addition to our team? Explore our available positions here. We’d love the chance to get to know you.  

Your challenge: 

As a Senior Big Data Engineer, you will join our growing Engineering team. You will work with teams of big data and software engineers to build data solution utilizing big data technologies such as Databricks, Snowflake, etc., Leveraging scala or python you will develop data pipelines to transform/wrangle/integrate the data into different data zones. You will enhance your skillset by learning from your seniors and share your knowledge to build sustainable solution. You will hold accountability for technical decisions.

The Senior Big Data Engineer at Definitive Healthcare:

• Ensures solutions are built using databricks, snowflake according to business and technical specifications.
• Deploy and support highly optimized solutions with a focus on automation.
• Support an error-free, predictable, high-performing platform in AWS
• Actively Contributes to architectural discussions around our data.
• Performs code reviews
• Is always thinking of better ways to do something
• Isn’t afraid to fail.
• Provide leadership to the ongoing maturity of the development process, coach/mentor the development team on best practices and methodologies for enhanced solution development.
• Cares deeply about quality
• Stay up to date on the relevant technologies, plug into user groups, understand trends and opportunities.

Skills we’re looking for:

• Must be results driven, customer focused, technologically savvy, and skilled at working in an agile development environment.
• Deep expertise in working with data (Structured, Unstructured etc.,)
• Strong Experience with at-least one scripting language i.e., Python, Scala, Java, C++ etc.,
• Deep Understanding of distributed computing principles
• Data modeling and processing fundamentals with large-scale (> 50B rows) data
• Experience with Apache Spark using Scala and Spark SQL (Batch, streaming)
• Demonstrated ability to create normalized and star-schema database designs using database modeling techniques. Superior understanding of normalization and denormalization.
• Expert Knowledge of Big Data PaaS components in the cloud, such as Databricks, Snowflake
• Working knowledge of RDBMS, NoSQL and Graph databases
• Knowledge of Hadoop, Spark, and HDFS
• Experience with containerization 
• Experience with automation technologies such as Argo, Oozie, Airflow
• Knowledge of Linux/Unix

 

Why we love Definitive, and why you will too!

• Industry leading products
• Work hard, and have fun doing it
• Inc