Senior Data Engineer - GCP

Sr. Data Engineer | GCP

Kaizen Analytix LLC, an analytics products and services company that gives clients unmatched speed to value through analytics solutions and actionable business insights, is seeking qualified candidates for Senior Data Engineer who are highly skilled and experienced professional responsible for designing, developing, and maintaining data pipelines and data warehouses on Google Cloud Platform. The ideal candidate will have a strong understanding of data engineering principles and best practices, as well as experience with Google Cloud Platform technologies.

Responsibilities:

Analysis and Design

• Conducts fact-gathering sessions with users.
• Consults with Technical Managers and Business Owners to identify and analyze technology needs and problems.
• Performs data flow diagramming and/or process modeling (code architecture).
• Design, develop, and maintain data pipelines and data warehouses on Google Cloud Platform
• Work with stakeholders to gather requirements and define data models.

• Develop and deploy data pipelines using Google Cloud Platform tools and services.
• Implement data quality checks and monitoring.
• Troubleshoot data issues and performance problems.
• Work with other engineers to develop and maintain the company's data infrastructure.
• Stay up to date on the latest data engineering technologies and trends.

Strategy Alignment

• Works with the other technical team members to continually improve implementation strategies, development standards and other departmental processes and documentation.
• Provides technical assistance and mentoring to lower-level Data Engineers.
• Communicates plans, status, and issues to management on a regular basis.

• Adheres to department standards, policies, procedures, and industry best practices.

Job Requirements:

• Bachelor's/master’s degree in computer science, Information Systems, or a related field
• 5+ years of experience in data engineering

• Mandatory to have GCP Professional Data Engineer Certification
• Experienced in any kind of migration projects that involve data warehousing, migrating from databases from one technology to a different technology.
• Strong Python programming for developing ETL scripts.
• Strong understanding of data engineering principles and best practices
• Experience with Google Cloud Platform technologies, including BigQuery, Cloud Dataproc, Cloud Dataflow, and Cloud Data Fusion

• Experience with data modeling and data warehousing
• Experience with data quality checks and monitoring
• Must be aware of any IaC tools like Terraform, GCP Python Clients
• Must be aware of CI/CD pipelines and well-versed in using any of the tools like Jenkins, Cloud Build, TeamCity for creating required pipelines for CI/CD.
• Takes initiative and proposes solutions and workarounds; readiness to work through tough deadlines.

• Troubleshoot key customer implementation issues and demonstrate the ability to drive to a successful resolution.
• Responsible for end-to-end Solution Design, Architecture, and best practices to integrate with GCP ecosystem and infrastructure.
• Ability to partner with domain architects to develop the end-to-end solution architecture including application, infrastructure, data, integration, and security domains.

Good to have:

• Experience in application development using any of the programming languages
• Prior experience of big data tools and concepts such as Hadoop, MapReduce, Spark, Hive, HBase, Apache Airflow(orchestration)