Cloud Data Engineer- GCP

Company Description

Merkle is a leading technology-enabled, data-driven customer experience management (CXM) company. For over 30 years, Fortune 1,000 companies and leading nonprofit organizations have partnered with us to build and maximize the value of their customer portfolios. With more than 9,600 smart, dedicated people in more than 50 offices around the world, we are still growing at a rate that outpaces the market, with 2019 net revenue of $1.1 billion.

Job Description

• Applicants must currently be authorized to work in the U.S. on a full-time basis. No sponsorship or work transfers are available for this position
• Applicants must currently live in and have a permanent residence in the United States 

Merkle is looking for experienced Cloud professionals to be part of its Cloud practice. You will be working on industry leading public Cloud platforms, Google Cloud Platform to design, develop, and implement next generation marketing solutions leveraging cloud native and commercial/open source big data technologies.

You will be responsible for designing, building, and maintaining data pipelines and systems that operate on cloud-based infrastructure. You will work closely with data scientists, data analysts, and software engineers to develop and deploy data pipelines, and to ensure that data is available and accessible for analysis.

Key Responsibilities  

• Designing, building, and maintaining scalable data pipelines that collect, process, and store large amounts of data on cloud platform GCP.
• Implementing and managing data workflows, including data ingestion, processing, and transformation using tools such as Apache Airflow, Apache Beam.
• Develop real time integrations using event driven architectures and micro services.
• Developing and maintaining data storage and retrieval systems using cloud-native data stores such as S3, Google Cloud Storage.
• Collaborating with data scientists and analysts to optimize data infrastructure and ensure timely access to accurate data.
• Ensuring data quality and accuracy by developing and implementing data validation and verification processes.
• Building and maintaining data catalogs and metadata repositories to ensure that data is easily discoverable and understandable.
• Troubleshooting and resolving issues related to data pipelines and infrastructure.

• Staying up-to-date with emerging technologies and industry trends related to cloud data engineering.
• Collaborate with cloud architects, tech leads, front end developers, back end developers, QA, business stakeholders, and project managers to design and build services on the cloud for applications on the Web or on edge devices.
• Develop reference architectures and design pattern library for typical Cloud based solutions implementations
• Advise on Cloud project set up, security and role based access implementation, and network optimizations
• Conduct training and enablement programs for Merkle’s internal delivery teams
• Hands-on work as part of a global team and coach off shore developers
• Participate in technical interactions with client’s executives and senior management
• Participate in technical customer engagements such as Proof of Concepts, project delivery for key strategic opportunities.
• Develop end-to-end Enterprise grade Concept Solutions, facilitate discussions with business & IT stakeholders and highlighting the outcomes that can be delivered through these solutions.

Qualifications

• Must be able to work on PST work schedule 
• 5+ year’s design and/or implementation of enterprise applications
• 3-5+ years working on Google Cloud (GCP) 
• 3+ years on Databricks, snowflake, Big query or other MPP systems
• 3+ years’ experience in “migrating” on premise workloads 
• Proficiency in SQL and database table design – able to write structured and efficient queries on large data sets
• Experience in AGILE development, SCRUM and Application Lifecycle Management (ALM) with scripting experience in Python or Java or NodeJS.
• Experience using real time integration services like Kafka, Pub/Sub, Lambdas, Functions etc…
• Hands-on experience in full life-cycle of software development or methodology using Agile Scrum/Kanban etc; requirements analysis, design, development testing and implementation
• Work with agile teams as they perform feature level design, development, testing, and performance analysis
• Develop the required technical modules/end-to-end solutions for multi layered applications on a variety of technology stacks
• Proven track record of building technical and business relationships with stakeholders
• Exceptional verba