Big Data Lead

Role: Azure Solution Architect

Location: Mount Laurel, NJ

Duration: FTE/C2C

Mode of work: Hybrid (2 days onsite/per week)

Primary Skills: Solutions Architecture, Data Modeling, Azure, Databricks, PySpark

Job duties: 

• Design scalable, secure, and high-performance cloud solutions on Microsoft Azure services
• Design large-scale data processing and analytics solutions using Azure Databricks.
• Develop comprehensive architecture blueprints and technical documentation for data solutions.
• Lead the implementation of Databricks-based solutions, ensuring alignment with best practices and business requirements.
• Lead Data Mesh/Data products architecture building in Databricks-based solutions
• Provide technical leadership and guidance throughout the project lifecycle.
• Lead the implementation of Azure-based solutions, ensuring alignment with best practices and business requirements.
• Collaborate with stakeholders to gather requirements and translate them into technical solutions.
• Design and implement CI/CD pipelines using Azure DevOps.
• Ensure robust security measures are in place, including identity management, encryption, and network security.
• Optimize cloud resources for performance, cost, and reliability.
• Stay updated with the latest Azure services, features, and industry trends. Requirements:
• Bachelor’s degree in computer science, Engineering, or a related field.
• 10-15 years of experience in data engineering or a related field.
• Extensive experience with Databricks and Apache Spark.