Jobs and Careers
QA
Senior Data Engineer
QarikNew York City, United StatesRemotefull_timeVerifiedPosted 29 Jun 2023
About the role
Qarik Overview
Co-Founded by Google Cloud Engineering leaders and backed by Peak 6 Investments, Qarik (pronounced “KAR-ik,” meaning “rock” in Gaelic) is an IT Solutions company with a focus on Google Cloud Platform (GCP) strategy and implementation. We’ve grown to over 100 employees in less than three years and continue to attract brand name (F1000) clients.
We strive to work “with” our clients. We embrace agile instead of deliverables and milestones - establish a vision, create a theme-based roadmap and execute. We work in the trenches with our clients to learn from each other's experiences and capabilities.
We’re an enabler (in a good way). Unlike the traditional IT Solutions model, where consultants can remain long beyond project completion, we enter our engagements with the end in mind. Core to our ethos is the ability to solve complex problems and teach clients to do the same.
We are seeking a seasoned Senior Data Engineer with a minimum of 5 years of experience to join our team. The ideal candidate will possess a deep understanding of large-scale data processing systems, with a focus on designing and building both batch and streaming data pipelines. You will play a vital role in managing our data and ensuring its accessibility, security, and accuracy.
Qarik is an Equal Opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity and expression, national origin, disability, or protected veteran status. For further information please contact our careers@qarik.com
Co-Founded by Google Cloud Engineering leaders and backed by Peak 6 Investments, Qarik (pronounced “KAR-ik,” meaning “rock” in Gaelic) is an IT Solutions company with a focus on Google Cloud Platform (GCP) strategy and implementation. We’ve grown to over 100 employees in less than three years and continue to attract brand name (F1000) clients.
We strive to work “with” our clients. We embrace agile instead of deliverables and milestones - establish a vision, create a theme-based roadmap and execute. We work in the trenches with our clients to learn from each other's experiences and capabilities.
We’re an enabler (in a good way). Unlike the traditional IT Solutions model, where consultants can remain long beyond project completion, we enter our engagements with the end in mind. Core to our ethos is the ability to solve complex problems and teach clients to do the same.
We are seeking a seasoned Senior Data Engineer with a minimum of 5 years of experience to join our team. The ideal candidate will possess a deep understanding of large-scale data processing systems, with a focus on designing and building both batch and streaming data pipelines. You will play a vital role in managing our data and ensuring its accessibility, security, and accuracy.
Key Responsibilities
- Design, develop, and deploy large scale data processing pipelines, both batch and streaming, using technologies such as Dataflow, Apache Beam, Spark, Akka, Pub/Sub.
- Expertise with multiple data storage technologies such as Bigtable/HBase, BigQuery, Spanner, CloudSQL/Postgres.
- Work with stakeholders to understand business problems, develop use-cases, and translate them into pragmatic and effective technical solutions.
- Design and develop appropriate schema for data based on understanding of the domain problem.
- Manage data lineage and ensure data security with appropriate tools and methodologies.
- Collaborate with data scientists, architects, and other stakeholders to ensure alignment between technical and business strategy.
- Continuously monitor, refine and report on the performance of data management systems.
- Mentor junior data engineers, reviewing their outputs and directing their professional development.
Required Skills and Qualifications
- A minimum of 5 years of experience in data engineering, particularly in designing and developing data pipelines.
- Proven expertise with technologies such as Dataflow, Apache Beam, Spark, Akka, Pub/Sub.
- Experience with various data storage technologies including Bigtable/HBase, BigQuery, Spanner, CloudSQL/Postgres.
- Ability to design data schemas based on an understanding of the domain problem.
- Experience with data security and data lineage methodologies and tools is preferred.
- Familiarity with agile development methodologies.
- Exceptional communication skills, able to explain complex technical concepts in clear, plain English.
- BSc degree in Computer Science, Engineering or a related field, or equivalent work experience.
Qarik is an Equal Opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity and expression, national origin, disability, or protected veteran status. For further information please contact our careers@qarik.com
Apply for this role
Generate a tailored application kit with a matched cover letter, interview prep, and CV highlights — in under 60 seconds.
Apply Now →Generate Application KitFree account required — sign up in 30s