Senior Data Engineer

Job Title

Senior Data Engineer

Location

Asda House

Employment Type

Full time

Contract Type

Permanent

Hours Per Week

37.5

Salary

Competitive salary plus benefits

Category

Data Science

Closing Date

6 June 2024

 

We are looking for an Azure Senior Engineer to join our Data Insights and Analytics team. The role will be responsible for building new data pipelines and optimizing data flows using the Azure cloud stack.

The ideal candidate will be an experienced data pipeline builder and data wrangler who enjoys building data products from scratch. The data engineer will need to support Business Analysts and Data Architects with discovery and best practices. The successful candidate must be self-directed and comfortable supporting the data needs of multiple teams, systems and products.

The ideal candidate will be an experienced data pipeline engineer and data specialist who enjoys building data products from scratch as most of the projects will be Greenfield.

• Proficient with Azure Data Services such as Azure Data Lake Storage, Azure Databricks, Azure Synapse Analytics, and Azure Data Factory for efficient data ingestion, processing, storage, and analytics workflows.
• Experienced in building and optimizing ‘big data' data pipelines, architectures and data sets using PySpark and SparkSQL.
• Experienced in building, deploying, sharing, and maintaining enterprise-grade data solutions with Databricks
• Experience building real-time data pipelines using Event-hub, storage queues and Azure stream analysis.
• Strong analytic skills related to working with unstructured datasets.
• Build processes supporting data transformation, data structures, metadata, dependency and workload management.
• Experience with Object-oriented/ object function scripting languages: Python preferred.
• Excellent communication skills and the ability to collaborate effectively with cross-functional teams in a fast-paced environment
• Experience of coaching, mentoring and providing technical guidance to junior colleagues.

Work Where it Works

Our hybrid way of working gives you the choice to work where it works.  This enables you to chose where you’ll be the most effective.  It offers a mix of working from home and in an office environment that works best for you and your team. 

You will also get an excellent benefits package including; -

•    Discretionary company bonus

•    £5,700 company car or car allowance
•    Company pension up to 7% matched
•    10% colleague discount, free parking and many additional rewards.

We want all colleagues to be able to bring their best and true selves to work, every day. Simply put, we want our colleagues to be Proud to be Asda and proud to be themselves