Senior Big Data Engineer - Data&AI

<h3>Job Description</h3><p><strong>The salary range for this position is (contract of employment):</strong></p><p><strong>junior:</strong> 9 500 - 13 400 PLN brutto</p><p><strong>mid</strong>: 12 300 - 17 600 PLN in gross terms</p><p><strong>A hybrid work model that incorporates solutions developed by the leader and the team.</strong></p><p>As part of the Data &amp; AI area, we implement projects based on the practical "data science" and "artificial intelligence" applications of an unprecedented scale in Poland. Data &amp; AI is a group of over 100 experienced BigData engineers organized into over a dozen teams with various specializations. Some of them build dedicated tools for creating and launching BigData processes or implementing ML models for the entire organization. Others work closer to the client and are responsible for the implementation of the search engine, creating recommendations, building a buyer profile or developing an experimental platform. There are also research teams in the area whose aim is to find solutions to non-trivial problems requiring the use of machine learning.</p><p><strong>We are looking for BigData engineers who want to build a data platform and solutions for millions of Allegro customers, e.g.:</strong></p><ul><li>A system that provides the ability to materialize events (received from microservices) into a form that allows building tables using Big Data tools. Our daily challenges are the scale of traffic, information structuring and stream synchronization of collections between on-premises solutions and public cloud environments</li><li>Metadata aggregation processes, integrated with Allegro's data platform to support tools and processes in the areas of: Data Quality, Data Lineage and Data Governance</li></ul><p><strong>We are looking for people who:</strong></p><ul><li>For several years are programming in technologies run on JVM</li><li>Have experience in <strong>Scala</strong> or want to develop in this direction</li><li>Have experience in the Big Data ecosystem (Hadoop, Spark, Airflow)</li><li>Have knowledge of GCP (Dataproc, Dataflow, BigQuery, Pubsub) will be an added advantage</li><li>Have ideas and willingness to get involved in designing solutions architecture</li><li>Are looking for effective solutions to the requirements set by users</li><li>Are interested in a variety of tools and the possibility of using them appropriately to the problem</li><li>Are maintaining good programming practices</li><li>Like to share their knowledge and experience with others</li><li>Want to constantly develop and update their knowledge</li><li>Know English at B2 level</li></ul><p><strong>What we offer:</strong></p><ul><li><strong>A hybrid work model </strong>that you will agree on with your leader and the team. We have well-located offices (with fully equipped kitchens and bicycle parking facilities) and excellent working tools (height-adjustable desks, interactive conference rooms)</li><li><strong>Annual bonus </strong>up to 10% of the annual salary gross (depending on your annual assessment and the company's results)</li><li>A wide selection of <strong>fringe benefits in a cafeteria plan</strong> – you choose what you like (e.g. medical, sports or lunch packages, insurance, purchase vouchers)</li><li><strong>English classes</strong> that we pay for related to the specific nature of your job</li><li><strong>Laptop with m1 processor</strong>, 32GB RAM, SSD - a 16” or 14” MacBook Pro or corresponding Dell with Windows (if you don’t like Macs), two monitors and all other gadgets that you should need</li><li>Working in a<strong> team you can always count on </strong>— we have on board top-class specialists and experts in their areas of expertise</li><li>A high degree of autonomy in terms of organizing your team’s work; we encourage you to develop continuously and try out new things</li><li><strong>Hackathons, team tourism, training budget and an internal educational platform, MindUp</strong> (including training courses on work organization, means of communications, motivation to work and various technologies and subject-matter issues)</li><li>If you want to learn more, <a href="https://allegro.tech/booklet.pdf"> check it out</a></li></ul><p><strong>Why is it worth working with us?</strong></p><ul><li>The IT team is made up of over 1700 members who have shared their knowledge at multiple conferences, such as Devoxx, Geecon, Confitura and co-create a blog:<a href="https://blog.allegro.tech/"> allegro.tech</a></li><li>Microservices – a few thousand microservices and 1.8m+ rps on our business data bus</li><li>Big Data – several petabytes of data and Machine Learning used in production</li><li>We practice Code Review, Continuous Integration, Scrum/Kanban, Domain Driven Design, Test Driven Development, Pair Programming, depending on the team</li><li>Our internal ecosystem is based on self-service and widely used tools, such as Kubernetes, Docker, Consul, GitHub or GitHub Actions. This will al