Data Engineer (Mid/Senior/Lead)

Imagine a place where your ideas are not just heard but supported. Welcome to Addepto, the leading AI & Big Data technology and consulting company, where we partner with top-tier global enterprises and pioneering start-ups to deliver transformative projects.

Are you an experienced Data Engineer (Mid/Senior/Lead) who focuses on designing and implementing scalable data processing architectures? Do you have a strong consulting approach and enjoy working with clients? If yes, keep reading :)

As a Data Engineer, you will:

• Design and develop scalable data processing architectures, infrastructure, and platform solutions for streaming and batch processing using Big Data technologies like Apache Spark and Hadoop.

• Develop applications to aggregate, process, and analyze data from diverse sources.

• Collaborate with the Data Science team on Machine Learning projects, including text/image analysis and predictive model building.

• Manage distributed database systems such as ClickHouse, BQ, Teradata, Oracle Exadata, PostgreSQL + Citus Modeling, Star, and Snowflake schema.

• Develop and organize data transformations using DBT and Apache Airflow.

• Translate business requirements into technical solutions and ensure optimal performance and quality.

Requirements

What you’ll need to succeed in this role:

• Bachelor’s degree in technical or mathematical studies.

• Proven commercial experience in implementing, developing, or maintaining Big Data systems.

• Proficiency in Python (or Java/Scala) and hands-on experience with Apache Spark, Cloudera, Data Platform, Airflow, and NiFi.

• Familiarity with Big Data technologies like Databricks, Docker, Kubernetes, Iceberg, Trino, and Hudi.

• Proven expertise in implementing and deploying solutions in cloud environments (with a preference for AWS).

• Excellent understanding of dimensional data and data modeling techniques.

• Strong consulting experience with excellent communication and client management skills, including prior experience directly interacting with clients as a consultant.

• Ability to work independently and take ownership of project deliverables.

• Experience with an MLOps framework such as Kubeflow or MLFlow.

Check out our recent Big Data projects:

• Data lakes, which store terabytes of data and process Machine Learning tasks for a big telecom company.

• Streaming applications to server data analytics in real-time for manufacturing companies.

• Systems that support the decision-making process and help to analyze data in a unified format for controlling and operations departments.

• Support real-time Machine Learning prediction on massive datasets, which prevents company losses for pharmaceutical companies.

• And more!

Discover our perks & benefits:

• Work in a team of passionate enthusiasts of Big Data & Artificial Intelligence.

• Engage with top-tier global enterprises and cutting-edge startups on international projects, contributing to state-of-the-art AI & Big Data developments.

• Enjoy flexible work arrangements, allowing you to work remotely or from modern offices and coworking spaces across Poland.

• Accelerate your professional growth through internal career paths, knowledge-sharing initiatives, language classes, and sponsored training or conferences.

• Choose from various employment options: B2B, employment contracts, or contracts of mandate.

• Make use of 20 fully paid days off available for B2B contractors and individuals under contracts of mandate.

• Participate in team-building events and utilize the integration budget.