Big Data Principal

Job Description: Primary: Azure Cloud Experience, Azure Databricks, Pyspark, ETL coding , design and development., SQL , Unix/Linux , CI/CD pipeline. Jira, Confluence with Data modeling experience in Azure We are seeking a skilled Sr. Data Modeler to join our team and contribute to the design and implementation of scalable and efficient data models. The ideal candidate will have experience with Data Vault techniques, proficiency in Cloud Azure, and good to have working knowledge with Databricks. Responsibilities: • Data Modeling: o Design and develop data models using Data Vault methodologies to ensure robust, scalable, and flexible data architectures. o Create and maintain conceptual, logical, and physical data models to support business requirements. o Collaborate with stakeholders to understand data requirements and translate them into effective data models. o Implement best practices for data modeling, including normalization, denormalization, and data integration. • Data Vault Implementation: o Utilize Data Vault techniques to build enterprise data lake and lake house and integrate disparate data sources. o Design and implement Hubs, Links, and Satellites to ensure comprehensive data capture and historical tracking. o Optimize data vault models for performance and scalability. • Cloud Azure: o Design and deploy data models on Azure Data Services, including Azure SQL Database, Azure Data Lake, and Azure Synapse Analytics. o Ensure data security, compliance, and best practices in Azure environments. • Collaboration and Communication: o Work closely with data engineers, data scientists, and business analysts to understand data needs and ensure data model alignment. o Provide technical guidance and support on data modeling best practices and Data Vault principles. o Document data models, data flows, and integration processes clearly and comprehensively. • Data Modelling tools Azure: • Data analysis and modeling tools (e.g. Power Designer, ERWin, ER/Studio