Jobs and Careers
VI
Big Data DevOps Engineer
VirtusaPittsburgh, United Statesfull_timeVerifiedPosted 13 Oct 2025
About the role
Big Data DevOps Engineer - (CREQ235077)
Design, implement, and optimize scalable Big Data ETL pipelines using Hive and Spark.
Manage and maintain HDFSbased data storage systems.
Collaborate with Data Engineers, DevOps, and Application teams for data flow orchestration and optimization.Perform root cause analysis and provide L2/L3 production support for data infrastructure issues.Monitor system performance and automate processes in a Linux-based environment.
Ensure high availability and disaster recovery setup for big data platforms.
Follow DevOps best practices for CI/CD pipelines, version control, and deployment.
Document systems architecture, processes, and runbooks.
Mandatory Skills
Technical Skills Strong hands-on experience in Big Data tools (HDFS, Hive, Spark), ETL pipeline development, and production support in a Linux-based DevOps environment.
Soft SkillsExcellent verbal and written communication skills to effectively liaise between business stakeholders and IT teams.
Strong problem-solving abilities to identify and implement system improvements.
Attention to detail with the ability to analyze complex business processes and technical requirements.
Ability to work independently and manage multiple priorities efficiently.
Strong interpersonal skills for collaborating with diverse teams and clients.
Description
We are seeking an experienced Big Data DevOps Engineer with 8Plus years of expertise in designing, building, and supporting large-scale data processing systems. The ideal candidate will have strong handson experience with HDFS, Hive, Spark, and Linux environments, and will be responsible for developing robust ETL pipelines and providing endtoend production support.Design, implement, and optimize scalable Big Data ETL pipelines using Hive and Spark.
Manage and maintain HDFSbased data storage systems.
Collaborate with Data Engineers, DevOps, and Application teams for data flow orchestration and optimization.Perform root cause analysis and provide L2/L3 production support for data infrastructure issues.Monitor system performance and automate processes in a Linux-based environment.
Ensure high availability and disaster recovery setup for big data platforms.
Follow DevOps best practices for CI/CD pipelines, version control, and deployment.
Document systems architecture, processes, and runbooks.
Mandatory Skills
Technical Skills Strong hands-on experience in Big Data tools (HDFS, Hive, Spark), ETL pipeline development, and production support in a Linux-based DevOps environment.
Soft SkillsExcellent verbal and written communication skills to effectively liaise between business stakeholders and IT teams.
Strong problem-solving abilities to identify and implement system improvements.
Attention to detail with the ability to analyze complex business processes and technical requirements.
Ability to work independently and manage multiple priorities efficiently.
Strong interpersonal skills for collaborating with diverse teams and clients.
Primary Location
: US-PA-PittsburghSchedule
: Full TimeEmployee Status
: Individual ContributorJob Type
: ExperiencedTravel
: NoJob Posting
: 13/10/2025, 8:32:36 AMApply for this role
Generate a tailored application kit with a matched cover letter, interview prep, and CV highlights — in under 60 seconds.
Apply Now →Generate Application KitFree account required — sign up in 30s