Senior Big Data Engineer | Lisboa/Porto

About EY

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture, and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all.

 

The opportunity

EY is looking for a Senior Big Data Engineer to join our dynamic team, that focuses on implementing scalable data solutions and working in client engagement teams to deliver advanced analytics and technology consulting services. In this role, you will leverage your extensive experience in Big Data technologies to design and implement robust data pipelines and architectures that drive business success. You will play a crucial role in optimizing data processing workflows and ensuring the integrity, security, and availability of large-scale data assets.

 

Your key responsibilities

· Business Analysis: Collaborate with stakeholders to gather and analyze business requirements, translating them into technical specifications for Big Data solutions.

· Data Architecture & Design: Define and implement modern data architectures using distributed processing paradigms and scalable frameworks.

· Pipeline Development: Design, develop, and maintain data pipelines and frameworks for ingestion, transformation, and processing of structured and unstructured data.

· Performance Optimization: Optimize data workflows and distributed processing jobs to ensure efficiency and reliability at scale.

· Cross-Functional Collaboration: Work closely with data scientists, analysts, and other teams to integrate Big Data solutions into business processes.

· Monitoring & Troubleshooting: Ensure operational stability of Big Data platforms, proactively identifying and resolving issues.

· Data Security & Governance: Apply best practices for data quality, security, and compliance throughout the data lifecycle.

· Leadership & Planning: Coordinate technical teams, provide estimates, manage risks, and ensure timely delivery of Big Data projects.

· Documentation: Maintain comprehensive documentation of solution designs, processes, and procedures to facilitate knowledge sharing and compliance with organizational standards.

· Technical Support and Training: Provide technical support and training to end-users and development teams, fostering a culture of continuous improvement and knowledge sharing.

 

Skills and attributes for success

• Communication is essential, must be able to listen and understand the question and develop and deliver clear insights, in both verbal and written, with the ability to convey complex technical concepts to non-technical stakeholders. • Independent and able to manage and prioritize workload. • Ability to adapt quickly and positively to change. • This position will require strong analytical and problem-solving skills, with a keen attention to detail. • You will also be a part of larger team (incl. client-side stakeholders), so communication and collaboration skills will also help you to succeed.

· A proactive approach to identifying and resolving issues

 

To qualify for the role, you must have

• Proven experience (more than 4 years) in Big Data projects, including design, modeling, implementation, and evolution of data solutions (data lakes, lakehouses, pipelines).

• Deep knowledge of Big Data fundamentals and lifecycle (collection, integration, quality control, processing, visualization, dissemination).

• Hands-on experience with Big Data platforms and technologies (e.g., Spark, Databricks, Azure Synapse, Kafka, MS Fabric).

• Expertise in distributed storage (S3, Blob, ADLS) and file formats (Parquet, Avro, Delta).

• Advanced programming skills in Python and SQL.

• Familiarity with cloud Big Data services (Azure, AWS, GCP).

• Experience as team leader or tech lead, including planning, risk management, and stakeholder engagement.

• Strong background in Agile methodologies and DevOps/DataOps practices.

• Knowledge of CI/CD principles, version control, and automated testing (e.g., TFS, GitHub).

 

Ideally, you'll also have

· Experience with visualization tools and preparing data for business consumption.

· Relevant certifications in Big Data or cloud technologies.

 

What we look for 
An effective communicator and you’ll be a confident team player equipped with strong people management skills; Creative, proactive, a team player, and able to work under pressure. It’s important to have a strategically focused mindset and the ability to deliver multiple proje