Lead Azure Data Engineer

Position Summary

Ryan Specialty is a leading international specialty insurance firm which offers wholesale brokerage services; delegated underwriting expertise in the form of binding authorities, programs, and highly specialized managing general underwriting companies; and other services designed specifically for brokers, agents, and insurers. Ryan Specialty’s mission is to be the most trusted trading partner of insurance brokers, agents, and insurance carriers. We are seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team. This individual will be instrumental in administering, optimizing, and innovating our data engineering practices and infrastructure, particularly in an Azure environment (YAML). This person will ensure that our data engineering practices are aligned with the latest technologies and industry best practices, focusing on performance, reliability, and efficiency.

What will your job entail?

• Provide technical leadership in data architecture and engineering, collaborating with solution stakeholders to align data solutions with business objectives.

• Mentor less experienced data engineers and team members, fostering a collaborative and innovative work environment.

• Explore and implement new technologies and practices in data engineering to continually improve our data processes and infrastructure.

• Manage and enhance complex SSIS packages for data integration and ETL processes, along with SSRS reports for business intelligence.

• Design, build, and maintain scalable and efficient data pipelines using Azure Data Factory, implementing both batch and real-time data integration processes.

• Develop and optimize Databricks notebooks for big data processing and analytics in Azure Databricks environments.

• Implement and manage data storage solutions using Delta Parquet files in Azure Data Lake Storage, optimizing for query performance and cost-efficiency.

• Integrate and configure Profisee Master Data Management tools within Azure, focusing on data governance and quality.

• Set up and manage Change Data Capture processes for real-time data synchronization in Azure data platforms.

• Enhance and support Power BI reporting solutions, developing complex dashboards, and integrating with Azure data services.

• Drive automation and process optimization using Azure services and scripting and implement CI/CD pipelines using Azure DevOps (YAML).

• Lead SQL Server database optimization and performance tuning efforts.

Education/Experience/Skills

• BA/BS degree in a technical field.

• Demonstrated technical leadership and experience in collaborating with business analysts, data analysts, IT teams, and other stakeholders.

• Experience in implementing innovative data solutions and staying abreast of the latest trends in data engineering.

• Expertise in SQL Server Management, Azure Data Factory Development, Databricks Engineering, Delta Parquet File Management, and SQL Server Integration Services.

• YAML

• Proficiency in Profisee MDM Integration, Change Data Capture implementation, and data quality and governance.

• Proven experience in with BI Reporting, and strong skills in Automation and Process Optimization.

• Intellectual curiosity with a strong drive to learn

• Critical thinker with an open mind to innovative solutions

• High emotional intelligence

• Exceptional communication skills

• Strong collaboration and relationship building skills

• Ability to navigate ambiguity

• Highly structured in execution

• Skilled at simplifying complex environments

*Ryan Specialty does not offer work visa sponsorship

Ryan Specialty is an Equal Opportunity Employer. We are committed to building and sustaining a diverse workforce throughout the organization. Our vision is an inclusive and equitable workplace where all employees are valued for and evaluated on their performance and contributions. Differences in race, creed, color, religious beliefs, physical or mental capabilities, gender identity or