Senior Data Engineer - Azure

We are hiring near our Irving, Texas COE.

About Gartner IT:

Join a world-class team of skilled engineers who build creative digital solutions to support our colleagues and clients.  We make a broad organizational impact by delivering cutting-edge technology solutions that power Gartner.  Gartner IT values its culture of nonstop innovation, an outcome-driven approach to success, and the notion that great ideas can come from anyone on the team.  

About the role:

Gartner is looking for a well-rounded and motivated developer to join its team which is responsible for developing scalable and configurable data engineering pipelines. These efforts will help us curate and deliver data optimally and efficiently to downstream applications. .

What you will do:

• Participate in architecture design and implementation of high-performance, scalable, and optimized data solutions. 

• Design, build and automate the deployment of data pipelines and applications to support data scientists and researchers with their reporting and data requirements. 

• Integrate data from a wide variety of sources, including on premise databases and external data sources with rest APIs and harvesting tools. 

• Collaborate with internal business units and data science teams on business requirements, data access, processing/transformation and reporting needs and leverage existing and new tools to provide solutions. 

• Effectively support and partner with businesses on implementation, technical issues, and training on the data lake ecosystem 

• Work with team on managing AWS resources (EMR, ECS clusters, etc.) and continuously improve deployment process of our applications 

• Work with administrative resources and support provisioning, monitoring, configuration, and maintenance of AWS tools. 

• Promote the integration of new cloud technologies and continuously evaluate new tools that will improve the organization’s capabilities while leading to lower total cost of operation. 

• Support automation efforts across the data analytics team utilizing Infrastructure as Code (IaC) using Terraform, Configuration Management, and Continuous Integration (CI) / Continuous Delivery (CD) tools such as Jenkins. 

• Work with the team to implement data governance, access control and identify and reduce security risks. 

What you will need :

Strong IT professional with 5-6 yrs of experience in software development for data engineering using Azure.

The candidate should have strong problem-solving skills along with high on ownership and accountability. 

Must have:

• 5 + years of experience in Solution, Design and Development of Cloud based data models, ETL Pipelines and infrastructure for reporting, analytics and data science

• Experience working in different programming languages (Java, python, scala) and  version control tools (Git, Subversion)"Azure Data Factory" or "Data Factory" or "ADF" OR "azure Databricks"  and " data engineer"

• Experience working with both structured and unstructured data

• Strong understanding of OOPS, Design principles and Distributed systems and experience of Data Structures and algorithms

• Experience working in different programming languages (Java, python, scala) and  version control tools (Git, Subversion)"Azure Data Factory" or "Data Factory" or "ADF" OR "azure Databricks"  and " data engineer"

• Experience working with Spark/ Hive/HDFS 

• Experience using automated build systems (CI/CD)

• Experience in Azure

Who you are:

• Graduate/Post graduate in BE/Btech, ME/MTech or MCA is required or 5 years experience in leu of.

• Excellent communication and prioritization skills.

• Able to work independently or within a team proactively in a fast-paced AGILE-SCRUM environment.

• Owns success – Takes responsibility for successful delivery of the solutions.

• Strong desire to improve upon their skills in software development, frameworks, and 

Don’t meet every single requirement? We encourage you to apply anyway. You might just be the right candidate for this, or other roles.

#Technology

#LI - hybrid

# #LI-GV1

Who are we?

At Gartner, Inc. (NYSE: IT), we deliver actionable, objective insight that drives smarter decisions and stronger performance on an organization’s mission-critical priorities. We’ve grown exponentially since our founding in 1979 and we're proud to have over 19,500 associates globally that support over 15,000 client enterprises in more than 100 countries.

What makes Gartner a great place to work?

Our teams are composed of individual