Senior Data Engineer (Poland Remote)

<p><span>At First Advantage (Nasdaq: FA), people are at the heart of everything we do. From our customers and partners to our greatest advantage — our team members. Operating with empathy and compassion, First Advantage fosters a global inclusive workforce devoted to the diverse voices that make up our talent and products. Our team members empower each other to be their authentic selves and treat all with respect, integrity, and fairness. </span><br/><span>Say hello to a rewarding career and come join a leading provider of mission-critical background screening solutions to some of the most recognized Fortune 100 and Global 500 brands. </span><br/><br/><span><b>What We Do: </b></span><br/><span>We are on the frontline of recruitment enabling organizations to Hire Smarter. Onboard Faster™ First Advantage is an HR Tech company delivering innovative solutions and insights to enable our clients to manage risk and hire the best talent. Leveraging an advanced technology platform, First Advantage builds fully scalable, configurable screening programs that meet the unique needs of over 30,000 clients. Headquartered in Atlanta, GA and with an internationally distributed workforce spanning 17 countries with about 5,000 employees, First Advantage performs over 100 million screens in over 200 countries and territories annually.  </span><br/><br/><span><b>Who You Are: </b></span><br/><span>You are self-motivated and ready to “roll up your sleeves." While you are an independent contributor, you are also collaborative. You can spearhead a project and see it through from start to completion.  </span><br/><span>As a team player, you navigate cross-functional teams and work well with team members in other business units and departments toward a common goal.  </span><br/><span>An Innovator — you see gaps in current processes or workflows as an opportunity to improve and try something new. </span><br/><span>A lifelong learner and always seeking out opportunities to learn and upskill, you understand the importance of thorough and secure screenings and are interested in the Human Capital sector and the confluence of people, process, and technology. </span><br/><br/><span><b>What You'll Do:   </b></span><br/><span>We are seeking a Senior Data Engineer with solid Python/PySpark programming skills to join the Data Engineering Team and help us build the Data Analytics Platform in Azure cloud.</span><br/><br/><span><b>Responsibilities: </b></span></p><ul><li><span><span>Develop reusable, metadata-driven data pipelines</span></span></li><li><span><span>Automate and optimize any data platform related processes</span></span></li><li><span><span>Build integrations with data sources and data consumers</span></span></li><li><span><span>Add data transformation methods to shared ETL libraries</span></span></li><li><span><span>Write unit tests</span></span></li><li><span><span>Develop solutions for the Databricks data platform monitoring</span></span></li><li><span><span>Proactively resolve any performance or quality issues in ETL processes</span></span></li><li><span><span>Cooperate with infrastructure engineering team to set up cloud resources</span></span></li><li><span><span>Contribute to data platform wiki / documentation</span></span></li><li><span><span>Perform code reviews and ensures code quality</span></span></li><li><span><span>Initiate and implements improvements to the data platform architecture</span></span></li></ul><span><b>What You Need to be Successful: </b></span><ul><li><span><span>Programming: Python/PySpark, SQL</span></span></li><li><span><span>Proficient in building robust data pipelines using Databricks Spark</span></span></li><li><span><span>Experienced in dealing with large and complex datasets</span></span></li><li><span><span>Knowledgeable about building data transformations modules organized as libraries (Python packages)</span></span></li><li><span><span>Familiar with Databricks Delta optimization techniques (partitioning, z-ordering, compaction, etc.)</span></span></li><li><span><span>Experienced in developing CI/CD pipelines</span></span></li><li><span><span>Experienced in leveraging event brokers (Kafka /Event Hubs / Kinesis) to integrate with data sources and data consumers </span></span></li><li><span><span>Understanding of basic networking concepts</span></span></li><li><span><span>Familiar with Agile Software Development methodologies (Scrum)</span></span></li></ul><span><strong>Nice to Have Skills:</strong> </span><ul><li><span><span>Understanding of  stream processing challenges and familiarity with Spark Structured Streaming</span></span></li><li><span><span>Experience with IaC (Terraform, Bicep or other)</span></span></li><li><span><span>Experience running containerized applications (Azure Container Apps, Kubernetes)</span></span></li><li><span><span>Experience building event sourcing solutions</span></span></li><li><span><span>Familiarity with platforms for change data capture (e.g. Debezium)</span></