Senior Data Engineer

<p><b>Job Description &amp; Summary</b></p>We are seeking a highly skilled Senior Data Engineer with extensive experience in data engineering. The ideal candidate will have a strong background in SQL, proficiency in data visualization tools such as Power BI, and hands-on experience with PySpark and Scala Spark. Prior experience with the Quantexa platform and working with AWS is essential. Additionally, a solid understanding of DevOps is also a must.<p></p><p></p><p><b>Responsibilities:</b></p><ul><li><p><span>Design, develop, and maintain robust and scalable data processing pipelines using PySpark and Scala Spark;</span></p></li><li><p><span>Collaborate with cross-functional teams to define, design, and implement new features;</span></p></li><li><p><span>Cleanse, parse, and standardize global datasets;</span></p></li><li><p><span>Perform data classification and entity <span>extraction/resolution;</span></span></p></li><li><p><span>Optimize and improve data processing performance through big data testing;</span></p></li><li><p><span>Utilize pre-packaged code for processing and utilizing third-party data sources;</span></p></li><li><p><span>Ensure data quality and integrity through efficient data manipulation;</span></p></li><li><p><span>Help implement and configure Continuous Integration (CI) and Continuous Delivery (CD) tooling;</span></p></li><li><p><span>Help deploy updates and fixes, build and maintain highly available systems;</span></p></li><li><p><span>Implement and improve monitoring and alerting;</span></p></li><li><p><span>Perform root cause analysis for production errors and investigate/resolve technical issues;</span></p></li><li><p><span>Work in an Agile environment and contribute to the continuous improvement of our development processes.</span></p></li></ul><p></p><p><b>Requirements:</b></p><ul><li><p><span>Master’s degree in a related field;</span></p></li><li><p><span>At least 6 years of hands-on experience in data engineering;</span></p></li><li><p><span>Strong proficiency in SQL;</span></p></li><li><p><span>Proficiency in data visualization tools such as Power BI;</span></p></li><li><p><span>Solid experience with big data technologies like PySpark and Scala Spark;</span></p></li><li><p><span>Hands-on experience with the Quantexa platform is a must;</span></p></li><li><p><span>Prior experience working with AWS;</span></p></li><li><p><span>Familiarity with Agile development methodologies;</span></p></li><li><p><span>Strong problem-solving skills and attention to detail;</span></p></li><li><p><span>Excellent communication and teamwork abilities;</span></p></li><li><p><span>Experience with Airflow for workflow automation and scheduling;</span></p></li><li><p><span>Focus on Docker/Kubernetes;</span></p></li><li><p><span>Strong Linux system administration background;</span></p></li><li><p><span>DevOps tooling/automation written with Bash, Python, Groovy, Jenkins;</span></p></li><li><p><span>Experience with provisioning software/frameworks like Elasticsearch, Spark, Hadoop, PostgreSQL;</span></p></li><li><p><span>Knowledge of containerization technologies like Docker and orchestration tools like Kubernetes;</span></p></li><li><p><span>Experience working with Spring Boot Java framework.</span></p></li></ul><p></p><p></p><p><b><span>We offer:</span></b></p><ul><li><p><span>Interesting career development options and challenging assignments for top Romanian and international clients;</span></p></li><li><p><span>International mobility and short/medium-term projects abroad;</span></p></li><li><p><span>A professional and team-oriented work environment;</span></p></li><li><p><span>Great colleagues to work with;</span></p></li><li><p><span>Up-to-date technologies and methodology;</span></p></li><li><p><span>Professional development and training opportunities in Romania and abroad. </span><br/><b><span> </span></b></p></li></ul><p><br/> </p><p></p><p></p>