Senior Data Engineer

 

 

Important Information

Location: Latin America

Work Mode: Remote

 

Job Summary

As a Senior Data Engineer (12374), you will be responsible for designing, developing, and maintaining high-quality software solutions. You will collaborate with cross-functional teams to understand business requirements and translate them into scalable and efficient software applications. Your role will involve leading technical projects, mentoring junior engineers, and continuously improving software development practices to ensure the delivery of robust and reliable software systems.

 

Responsibilities and Duties

 

• Data Pipeline Development & Management: Create and maintain automated data pipelines to process large volumes of data using Python and Apache (e.g., Spark, Kafka), integrated with cloud services like AWS (S3, Redshift) and GCP (BigQuery).
• Cloud Infrastructure & Data Storage Optimization: Manage scalable cloud storage solutions with AWS (S3, Redshift) and GCP (BigQuery), ensuring efficient data access and processing.
• Data Integration & Processing: Design and implement data integration strategies, connecting various sources and processing data in real-time or batch using tools like Apache Kafka, Spark, and Python

Qualifications and Skills

• Graduates in systems, networks or related fields with +5 years of experience.
• Proven experience with AWS and Google Cloud Platform (GCP), specifically services like AWS S3, Redshift, Lambda and Google BigQuery, Cloud Storage.
• Expertise in Apache Spark and PySpark for data processing at scale.
• Hands-on experience with Databricks for collaborative data engineering and machine learning workflows.
• Proficient in Python for scripting and automation.
• Experience with Apache Airflow for data pipeline orchestration and automation.
• Strong understanding of Delta Lake and Parquet formats for optimized data storage and querying.
• Solid understanding of ETL/ELT processes and data warehousing concepts.
• Excellent problem-solving skills and the ability to work in a fast-paced environment.

 

 

About Encora

Encora is the preferred digital engineering and modernization partner of some of the world’s leading enterprises and digital native companies. With over 9,000 experts in 47+ offices and innovation labs worldwide, Encora’s technology practices include Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering.  

At Encora, we hire professionals based solely on their skills and qualifications, and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.