BigData DevOps Engineer

Company Description

About us, but we’ll be brief

Experian is the world’s leading global information services company, unlocking the power of data to create more opportunities for consumers, businesses, and society. We are thrilled to share that FORTUNE has named Experian one of the 100 Best Companies to work for. In addition, for the last five years we’ve been named in the 100 “World’s Most Innovative Companies” by Forbes Magazine. Experian prioritizes our culture and look to bring people to the team who are passionate about their jobs, who are easy to work with, and who continue to value team over self.

We have 23,000 people operating across 44 countries and every day we’re investing in new technologies, talented people, and innovation to help all our clients maximize every opportunity.

Job Description

As a motivated Individual and a passion for providing data-driven, CI-CD solutions, you’re key aide for both the IT Infrastructure and Development teams, you will help support existing DevOps implementation in Big Data environments.  The candidate will be responsible for managing Big Data Cluster environments and will work with teammates to build, maintain, develop, and integrate working solutions for our big data tech stack. To support the product development process in line with the product roadmap for product maintenance and enhancement such that the quality of software deliverables maintains excellent customer relationships and increases the customer base. 

If you have the skills and “can do” attitude, we would love to talk to you! 

What you’ll be doing.  

• Manage and optimize AWS resources, including EC2 instances, S3 buckets, Lambda functions, and other cloud-based services. 

• Managing application containerization using Docker and Kubernetes would be highly critical. 

• Deploy, configure, and maintain NoSQL databases such as Document DB, MongoDB, Cassandra, or DynamoDB. 

• Develop and maintain Terraform scripts for infrastructure as code (IaC) to provision and manage AWS resources. 

• Implement automated deployment pipelines using Terraform and other CI/CD tools for continuous integration and delivery. 

• Learn and configuration of monitoring systems (e.g Splunk, Dynatrace, CloudWatch, Prometheus, Cloudera Manager,). 

• Strong ability to take ownership of assigned tasks and responsibilities. 

• Aligning with the systems engineering team to learn and deploy new hardware and software environments required for Big Data Environments. 

• Collaborating with multiple teams to perform updates, patches, version upgrades when required. 

• General operational knowledge such as troubleshooting skills, understanding of system’s capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks 

• Understanding On-premises and Cloud network architectures 

• Ability to configure and support API and Open-Source integrations. 

• Help to shape enterprise solutions to allow better serviceability, monitoring and alerting to meet the increasing business requirements and demands. 

• Keep track of latest release versions and update the running workload consistently across stack. 

• Working with an agile team to develop, test, and maintain APIs 

• Assisting in the collection and documentation of user's requirements, development of user stories, and estimates 

• Preparing reports, manuals and other documentation on the status, operation and maintenance of software. 

• Will collaborate and communication with all levels of technical and senior business management 

• Will require on-call 24X7 support of production systems on a rotation basis with other team members 

• Pro-actively evaluate evolving technologies and recommend solutions to business problems. 

Qualifications

More about you 

• Typically requires a bachelor's degree (in Computer Science or related field) or equivalent. 

• 2+ years of DevOps Engineer Experience. 

• 1+ years of Linux (Redhat) system administration 

• Knowledge in Cloud Platforms IaaS/PaaS – Cloud solutions: AWS, Azure, Oracle Cloud, GCP, VMWare 

• Hands on skills with scripting in Terraform, Ansible would be mandatory. 

• Hands on experience with NoSQL Databases or Cloud Native databases. 

• Experience working with DevOps and Continuous Integration tools and technologies including Docker, Ansible, Bitbucket, Jenkins and Terraform. 

• Experience with Agile software development and DevOps methodologies, tools and practices. 

• Aware of operational Support needs and good with documentation and automat