Data Engineer (Python/Databricks)

About the company:

Softermii (https://www.softermii.com/) is an outsourcing/outstaffing company with more than 8 years of experience in web and mobile application development with a team of more than 120 specialists from 6 countries.

We have withstood multiple challenges, such as COVID-19 pandemic and war aggression against Ukraine, we have secured sustainable development processes, saved all our projects and jobs. Even more – we’re constantly growing.     

 

Every day we add new project to our portfolio in the following areas of expertise:

• Healthcare
• Real estate
• Livestream E-commerce
• Fintech (WealthTech, Capital Trading)
• Real Time Communications (RTC)

 

In addition, we develop 2 of our own solutions that help our customers get faster applications for video or audio calls (https://www.softermii.com/solutions/vidrtc) or an application for real estate with 3D visualization

(https://www.softermii.com/solutions/apartmii)

 

Company’s mission:

Softermii: Succeed Without (L) imitations

We will turn any idea into a valuable product.

 

Our plans as a company:

We want to move from a regular outsourcing business to an ecosystem of outsourcing, education and product development companies.

 

📲Project:

Team's goal is to deliver Hotel Business Management solution in a few phases starting MVP.

This tool will enable users to focus on Revenue Management, cover Guest Check-In experience, Marketing & Retention, Analytics & Reporting, Service Desk and other features that market requires.

Type of cooperation: Full-time

⚡️Your responsibilities on the project will be:

• Develop and maintain scalable data pipelines using Databricks (Apache Spark) for batch and streaming use cases.
• Work with data scientists and analysts to provide reliable, performant, and well-modeled data sets for analytics and machine learning.
• Optimize and manage data workflows using Databricks Workflows and orchestrate jobs for complex data transformation tasks.
• Design and implement data ingestion frameworks to bring data from various sources (files, APIs, databases) into Delta Lake.
• Ensure data quality, lineage, and governance using tools such as Unity Catalog, Delta Live Tables, and built-in monitoring features.
• Collaborate with cross-functional teams to understand data needs and support production-grade machine learning workflows.
• Apply data engineering best practices: versioning, testing (e.g., with pytest or dbx), documentation, and CI/CD pipelines.

You can be part of the following team: 

Client`s side: Business Owner, Senior AI/ML Engineer, Data Engineers, Subject Matter Experts.

On Softermii`s side: Software Architect, 2-3 React.js/Node.js Engineers, 2-3 AI/ML Engineers, 3 Data Engineers, DevOps, Business Analyst/Proxy PO, UI/UX Designer

2-3 Quality Assurance Engineers, Project Manager.

 

🕹Tools we use: Jira, Confluence, Git, Figma

 

🗞Our requirements to you:

• 3+ years of experience in data engineering or big data development, with production-level work on the Databricks platform.
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• Proficiency in Python (or Scala) and SQL for data processing and transformation on Spark.
• Hands-on experience with Apache Spark, Delta Lake, and Databricks Notebooks.
• Familiarity with Databricks Workflows, Unity Catalog, and Delta Live Tables for managing and securing data pipelines.
• Solid understanding of data lakehouse architecture, distributed computing, and performance tuning on Spark.
• Experience integrating data from cloud sources like AWS S3.
• Knowledge of orchestration tools (e.g., Airflow, Databricks Jobs), and CI/CD practices for data pipelines.
• Strong communication and collaboration skills, with a team-oriented mindset.
• Upper-Intermediate English level.

👨‍💻Who will you have the opportunity to meet during the hiring process (stages):
Call, HR, Tech interview, PM interview.

 

What we