Lead Data Engineer - Water and Environment (remote allowed)

As a Lead Data Engineer at Brown and Caldwell, you will play a pivotal role in designing, building, and maintaining robust data pipelines and architectures that enable effective data integration, storage, and analysis. We are using modern technology to transform the way that water is managed across the country. Your work will directly impact our ability to build digital solutions that ensure a future of clean water, thriving communities, and environmental protection.

• Collaborate with interdisciplinary teams of environmental engineers, data scientists, and software developers to understand data requirements and develop scalable data solutions.
• Design, implement, and maintain data pipelines to collect, clean, transform, and load data from various sources, including sensor data, historical records, and geospatial information.
• Create and manage data warehouses, data lakes, and databases to ensure efficient data storage, retrieval, and management.
• Develop and deploy ETL (Extract, Transform, Load) processes to support data analysis, visualization, and machine learning model training.
• Implement data quality and data governance processes to ensure accuracy, consistency, and integrity of data.
• Collaborate with IT teams to optimize data infrastructure, performance, and security.
• Stay up to date with emerging technologies, tools, and best practices in data engineering and environmental engineering to drive continuous improvement.

Desired Skills and Experience: 

• Bachelor's or Master's degree in Computer Science, Data Engineering, Data Science, Engineering, or a related field with a focus on data engineering, database management, or information systems.
• 8+ years of experience in data engineering, database design, and ETL development in a professional setting.
• High proficiency in programming languages such as SQL, Python, Java, or Scala, with experience in data processing system such as Apache Spark, Synapse Data Engineering in Microsoft Fabric, etc.
• Demonstrated knowledge of software engineering principles, version control, and best practices for writing clean, maintainable, and scalable code including development of custom GitHub Actions and Workflows for CI/CD. Familiarity with related data integration tools, data orchestration frameworks, and version control system.
• Solid understanding of database concepts, data modeling, and query optimization for both structured and unstructured databases.
• Experience with data warehousing solutions (e.g., Azure Synapse Analytics, Amazon Redshift), data lake solutions, and cloud platforms (e.g., Azure, AWS).
• Experience developing functional data processing workflows to transform raw data into reliable input for ML algorithms.
• Experience with streaming data pipeline setup and processing in IoT and edge compute applications.
• Hands-on experience with PySpark.
• Experience with Azure platform, DevSecOps and MLOps, specifically the following:
• Advanced knowledge of current Microsoft Azure products, including:
  • Azure Machine Learning Studio
  • Azure Data Factory
  • Azure Databricks
  • Azure Synapse
  • Azure Monitor and Azure EventGrid
  • Azure Cognitive Services

• Knowledge of geospatial data processing and analysis is a plus.
• Strong problem-solving skills and the ability to work in a collaborative, cross-functional environment.
• Excellent communication skills to interact with technical and non-technical stakeholders.
• A passion for staying updated with the latest trends, tools, and technologies in data engineering and environmental engineering.

Salary Range: The anticipated starting pay range for this position is based on the employee’s primary work location and may be more or less depending upon skills, experience, and education. These ranges may be modified in the future.

Location A:  $141,000 - $193,000

Location B:  $155,000 - $212,000

Location C:  $169,000 - $231,000

You can view which BC location applies to you here. If you have any questions, please speak with your Recruiter.

Benefits and Other Compensation:  We provide a comprehensive benefits package that promotes employee health, performance, and success which includes medical, dental, vision, short and long-term disability, life insurance, an employee assistance program, paid time off and parental leave, paid holidays, 401(k) retirement savings plan with employer match, performance-based bonus eligibility, employee referral bonuses, tuition reimbursement, pet insurance and long-term care insurance. Click h