Data Engineer

payabl. empowers businesses to grow through payments innovation and banking services. Our ambition is to expand our strong portfolio of global financial services we provide to businesses and make them all available in one place on our platform we call payabl.one. As a licensed financial company with principal membership with card schemes, we specialize in global payments and providing businesses with multi-currency accounts.

This role is about:

Data Team, where you play a vital role in collecting, analyzing, and interpreting data to support decision-making across the organization. Your tasks include data collection, ensuring quality, and developing databases. You're skilled in data platform development: data infrastructure, data ingestion, data transformation. Collaborative and communicative, you work with various teams to understand their needs and provide actionable insights. Passionate about staying updated with new technologies, you drive innovation and contribute to a culture of continuous improvement.

You will:

• Data Architecture Design: Design and implement scalable, reliable, and efficient data pipelines and infrastructure to ingest, process, and store large volumes of structured and unstructured data.
• Data Integration: Integrate data from various sources, both internal and external, ensuring compatibility, consistency, and reliability across datasets.
• Data Modeling: Develop and maintain data models to support analytics and reporting needs, ensuring data integrity, consistency, and optimization for performance. Design and implement OLAP (Online Analytical Processing) cubes and structures for multidimensional analysis.
• Data Quality and Governance: Implement processes and tools to ensure data quality, consistency, and compliance with regulatory requirements. Establish data governance policies and procedures.
• Performance Optimization: Monitor and optimize data pipelines and systems for performance, scalability, and cost-effectiveness. Troubleshoot and resolve issues as they arise.
• Collaboration: Collaborate with cross-functional teams, including analysts, software engineers, and business stakeholders, to understand data requirements and deliver solutions that meet business objectives.
• Documentation: Document data infrastructure, processes, and workflows to ensure knowledge sharing and maintainability.

What we need:

• Proven experience in data engineering or related roles, with a strong understanding of data structures, algorithms, data management principles, and best practices.
• Have experience working with real-time or near-real-time ingestion (Debezium, NiFi).
• Proficiency in programming languages such as Python and Java / Scala.
• Working knowledge of Unix OS / Shell scripting.
• Experience with ETL / ELT pipeline design, implementation, and orchestration (Airflow, Dagster, Luigi)
• Experience with SQL, relational, non-relational, and column-oriented databases (e.g., PostgreSQL, MySQL / MariaDB, Apache Druid, ClickHouse, MongoDB).
• Experience with big data technologies and frameworks such as Apache Iceberg / Hudi / Delta, Apache Spark / Apache Flink / AWS Glue, Apache Kafka / AWS Kinesis.
• Experience with data warehouse platforms such as Snowflake and Amazon Redshift, including data modeling (dbt), performance optimization, and administration.
• Familiarity with cloud platforms (AWS, Azure, GCP) and IaC (Terraform / Pulumi / AWS CDK).
• Experience with containerization and orchestration technologies such as Docker and Kubernetes / AWS EKS / Nomad.
• Experience with data visualization tools (Tableau, Power BI, Superset).
• Experience with finance data (transactions, payments, clearing reports).

The perks of being a payabl.er: 

• 🏦 Competitive Compensation: Step into a role that values your contributions with a market-aligned salary and bonus potential reflecting our annual success. 
• 📈 Empowered Career Trajectory: Unlock your full potential in a flat-hierarchy setting that fosters rapid professional growth and open dialogue. 
• 🌍 Global Perspectives: Immerse yourself in an international environment, enriching your career with diverse experiences and viewpoints. 
• 🤝 Community and Collaboration: Dive into a culture of unity through regular team events that build connections and foster collaboration.

Location:

• The role is open for Poland, Germany, Cyprus, Portugal or Lithuania.

The benefits list above, states the benefits for Poland location only, to be based on a fully remote work model on B2B contract.

As the role is open to multiple lo