Senior Data Engineer

Company Description

We help the world see new possibilities and inspire change for better tomorrows. Our analytic solutions bridge content, data, and analytics to help business, people, and society become stronger, more resilient, and sustainable.

Job Description

Join our Enterprise Data Management team as a Sr. Data Engineer. Preferably, role will be located in our Jersey City, NJ global headquarters which has a flexible hybrid work model. 

• Collaborate with data scientists, analysts, and other stakeholders to understand data needs and deliver appropriate solutions.
• Use tools like Databricks, Python, Spark, and other tools to build cutting-edge data pipelines and dynamic data solutions.
• Develop high-quality optimized code to process vast amount of data.
• Implement data improvements and optimization techniques to enhance the data products.
• Continuously evaluate and adopt new technologies and tools to enhance data engineering capabilities and efficiency.
• Build and maintain data pipelines to integrate data from various source systems.
• Optimize data pipelines for performance, reliability and cost-effectiveness.
• Perform data analysis required to troubleshoot and assist in resolving data issues.
• Handle production workload and resolve issues in timely manner.
• Work with enterprise cloud operations teams to implement best practices for performance monitoring, cloud resource management, including scaling, cost control and security.
• Stay up-to-date with the latest technologies and trends in data engineering, data warehousing, ETL, data quality, and modern ETL operations.
• Mentor and support junior data engineers as and when needed.

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Systems or a related STEM field.
• 8+ years of experience with data engineering, data warehousing, data architecture with substantial experience in managing large-scale data projects.
• Proven experience in implementing data quality, data management, data analysis and root cause analysis.
• Strong communication skills, a solid work ethic, and attention to detail.
• Must have 7+ years of experience with data platform services like Databricks, Spark, Python, SQL, NoSQL, Athena.
• Must have 5+ years of experience with Python and the Python ecosystem (PySpark, Pandas, DataFrames, etc.), showcasing the ability to write clean, maintainable, and robust code.
• 7+ years of experience with data solutions implementations in AWS Cloud platform technology.
• Familiarity with data pipeline orchestration tools like Step Functions, AirFlow or similar.
• AWS Certifications are plus.
• Passion for innovation and a commitment to delivering high-quality data solutions.
• 5+ years of experience with CI/CD, CloudFormation, Changeset execution and rollback.
• Experience with entity resolution or similar technology is plus.
• Provide afterhours or weekend support for ETL processes and troubleshoot any issues that may arise to ensure data integrity and timely completion of ETL tasks.

Additional Information

For over 50 years, Verisk has been the leading data analytics and technology partner to the global insurance industry by delivering value to our clients through expertise and scale. We empower communities and businesses to make better decisions on risk, faster.

At Verisk, you'll have the chance to use your voice and build a rewarding career that's as unique as you are, with work flexibility and the support, coaching, and training you need to succeed. 

For the eighth consecutive year, Verisk is proudly recognized as a Great Place to Work® for outstanding workplace culture in the US, fourth consecutive year in the UK, Spain, and India, and second consecutive year in Poland.  We value learning, caring and results and make inclusivity and diversity a top priority.  In addition to our Great Place to Work® Certification, we’ve been recognized by The Wall Street Journal as one of the Best-Managed Companies and by Forbes as a World’s Best Employer and Best Employer for Women, testaments to the value we place on workplace culture.

We’re 7,000 people strong.  We relentlessly and ethically pursue innovation. And we are looking for people like you to help us translate big data into big ideas. Join us and create an exceptional experience for yourself and a better tomorrow for future generations.

Verisk Businesses

Underwriting Solutions — provides underwriting and rating solutions for auto and property, general liability, and excess and surplus to assess and price risk with speed and precision

Claims Solutions — sup