Data Engineer (Hadoop)

<p> </p> <p><strong>CAPCO POLAND</strong></p> <p>Capco Poland is a global technology and management consultancy specializing in driving digital transformation across the financial services industry. We are passionate about helping our clients succeed in an ever-changing industry.</p> <p>We also are experts in    focused on development, automation, innovation, and long-term projects in financial services. In Capco, you can code, write, create, and live at your maximum capabilities without getting dull, tired, or foggy.</p> <p>We are looking for two Data Engineers to join one of our best-in-class Big Data projects related to building an ETL system using mainly Hadoop on-premises and additionally GCP cloud. Our clients' Big Data Lake is the largest aggregation of data ever within financial services with over 300 sources and a rapidly growing book of work.</p> <p> </p> <p><strong>THINGS YOU WILL DO</strong></p> <ul> <li>Deliver an ecosystem of curated, enriched, and protected sets of data – created from global, raw, structured, and unstructured sources</li> <li>Collect, store, analyze, and leverage data</li> <li>Integrate data with the architecture used across the company</li> <li>Data Engineering and Management</li> <li>Data development process: design, build and test data products that are complex or large-scale</li> <li>Promote development standards, code reviews, mentoring, testing, scrum story writing</li> <li>Cooperate with customers/stakeholders</li> </ul> <p> </p> <p><strong>TECH STACK:</strong> Hadoop, Spark 3.x, Scala 2.x/Python 3, SQL, BigQuery, DataProc, GCP, CI/CD, Agile, DevOps</p> <p> </p> <p><strong>SKILLS &amp; EXPERIENCES YOU NEED TO GET THE JOB DONE</strong></p> <ul> <li>Experience working with data pipeline building technologies: Python, Scala</li> <li>Strong experience with Hadoop eco-system and data management frameworks</li> <li>Good knowledge of Data warehouse concepts</li> <li>Good knowledge of SQL and relational database design</li> <li>Knowledge of CI/ CD, Agile, DevOps, Software Development Life Cycle (SDLC)</li> <li>Excellent communication, interpersonal, and decision-making skills</li> <li>Good English knowledge</li> </ul> <p><br/><strong>Nice to have:</strong></p> <ul> <li>Google Cloud Platform knowledge</li> <li>Elastic Search experience (Elastic/Logstash/Kibana etc.)</li> </ul> <p> </p> <p><strong>WHY JOIN CAPCO?</strong></p> <ul> <li>Employment contract and/or Business to Business - whichever you prefer</li> <li>Possibility to work remotely</li> <li>Speaking English on daily basis, mainly in contact with foreign stakeholders and peers</li> <li>Multiple employee benefits packages (MyBenefit Cafeteria, private medical care, life-insurance)</li> <li>Access to 3.000+ Business Courses Platform (Udemy)</li> <li>Access to required IT equipment</li> <li>Paid Referral Program</li> <li>Participation in charity events e.g. Szlachetna Paczka</li> <li>Ongoing learning opportunities to help you acquire new skills or deepen existing expertise</li> <li>Being part of the core squad focused on the growth of the Polish business unit</li> <li>A flat, non-hierarchical structure that will enable you to work with senior partners and directly with clients</li> <li>A work culture focused on innovation and creating lasting value for our clients and employees</li> </ul> <p> </p> <p><strong>ONLINE RECRUITMENT PROCESS STEPS</strong></p> <ul> <li>Screening call with the Recruiter</li> <li>Technical/Competencies interview with Capco Hiring Manager</li> <li>Culture fit with Head of Engineering</li> <li>Feedback/Offer</li> </ul> <p> </p> <p>Follow us here <a href="https://www.linkedin.com/company/capco/mycompany/" target="_blank"></a> <a href="https://www.instagram.com/lifeatcapco/" target="_blank"></a> <a href="https://nofluffjobs.com/company/capco-poland-nbqvkxp2" target="_blank"></a> or contact us directly <a href="mailto:recruiting.poland@capco.com" target="_blank">recruiting.poland@capco.com</a> </p> <p> </p>