Senior Data Engineer with Python

<p><b><span><span>What will you do?</span></span></b></p> <p> </p> <ul> <li><span><span>As a Senior developer you will be experienced in working with big data ingestion and large data sets in general. You will be responsible for creating and maintaining high quality ETLs. This is an exciting opportunity to build a new greenfield solution, working as part of a small team, to help the business improve their market making capabilities within the fixed income space. The platform itself is housed within the AWS ecosystem.</span></span></li> <li><span><span>Contribute and take ownership of the technical design and ensure all aspects of the system architecture are well documented.</span></span></li> <li><span><span>Work closely with partner technology teams and to collaborate effectively.</span></span></li> </ul> <p> </p> <p> </p> <p><span><span><b>Your skills:</b></span></span></p> <p> </p> <ul> <li><span><span>At least 4 years of commercial experience</span></span></li> <li><span><span>Very deep understanding of Python, Pyspark, Pandas, JulyterlLab.</span></span></li> <li><span><span>Experience in SQL, Hive, Hadoop.</span></span></li> <li><span><span>Experience using AWS platform.</span></span></li> <li><span><span>Solid experience with continuous integration and continuous delivery tools like Git, Jenkins etc.</span></span></li> <li><span><span>Agile development/Software life cycle</span>.</span></li> </ul> <p> </p> <p> </p> <p><b><span><span>Nice to have:</span></span></b></p> <p> </p> <ul> <li><span><span>Specifically, experience using EMR (Elastic Map Reduce) in AWS to run Spark lusters.</span></span></li> <li><span><span>Knowledge of Terraform.</span></span></li> <li><span><span>Experience with Ansible, Bash scripting, boto3.</span></span></li> <li><span><span>Experience configuring continuous integration and continuous delivery tools.</span></span></li> </ul> <p> </p> <p> </p> <p><b><span><span>We offer you:</span></span></b></p> <p> </p> <ul> <li><span><span>Contract of employment or B2B contract</span></span></li> <li><span><span>Hybrid work – 1/2 office days from Warsaw</span></span></li> <li><span><span>Working in a highly experienced and dedicated team</span></span></li> <li><span><span>Competitive salary and extra benefit package that can be tailored to your personal needs (private medical coverage, sport &amp; recreation package, lunch subsidy, life insurance, etc.)</span></span></li> <li><span><span>On-line training and certifications fit for career path</span></span></li> <li><span><span>Free on-line foreign language lessons</span></span></li> <li><span><span>Regular social events</span></span></li> <li><span><span>Access to e-learning platforms</span></span></li> <li><span><span>Ergonomic and functional working space with 2 monitors</span></span></li> </ul>