Senior Data Architect and Engineer

Who we are looking for

The successful candidate will be responsible for defining, planning and implementing technology solutions to achieve Bilateral Business Services. The individual will be responsible for working with Business and Technology counterparts across global sites as a Sr. Technical Analyst / UX Design Analyst and use their knowledge of the business systems, industry, and system development lifecycle methodology to direct the execution of complex projects throughout their life cycle.

Objectives:

• Implement a comprehensive collateral management platform that services client needs, drives simplification, and reduces redundant collateral capabilities bank wide
• Develop client facing technology solutions from inception to production working with the business team and the development team to deliver a seamless user experience.
• Implement standard, simplified data management and systems integration to ensuring flexible, robust overall offering

What you will be responsible for

As a data architect, you will play a crucial role in our data infrastructure and analytics initiatives. You will contribute to the design, development, enhancement & maintenance of data pipelines, ensuring data integrity, scalability and security. This is an opportunity to work within a very strong development team and help to develop new challenging features in the Collateral management using cutting edge technologies.

Hiring for a skilled data architect with 10+ years of experience with deep understanding of data processing frameworks and solid experience with ETL development using distributed computing frameworks as Apache Spark, Hadoop, Hive. Additionally, cloud experience particularly with Azure platform is highly desirable.

• Collaborate with stakeholders to design and build and maintain robust and scalable data pipelines to efficiently collect, transform and load high volume of data from various sources using data ingestion tools
• Develop and optimize data models & schema for analytical and operational use cases
• Establish data quality standards & best practices, implement data governance process and ensure data integrity, security and compliance
• Create visual representations of data to help business and organization understand complex information
• Work closely with infrastructure and DevOps teams to ensure the reliability, performance and scalability of our data infrastructure
• Build data integrations between on-prem/cloud-based systems
• Monitor and troubleshoot issues in production environment
• Drive continuous improvement initiatives to optimize performance, reliability and scalability of applications
• Mentor and coach team member on design, architecture, best practices and development methodologies
• Evaluate new technologies, frameworks and tools in the data engineering space to drive innovation and improve data processing capabilities

Core/Must have skills

• Good hands-on experience in Scala/Python with strong experience in Spark scala/PySpark and Spark SQL for data processing
• Hands-on experience in SQL, PL/SQL, Unix Shell Scripting, Autosys/Airflow
• Experience with relational databases such as Oracle, PostgreSQL as well as NoSQL databases
• Data integration techniques and tools including APIs and data streaming
• Strong analytical and problem solving skills, with the ability to identify and resolve issues in data piplelines and systems
• Experience with Agile software development methodology and version control systems like GitHub
• Expertise in Data Modeling and DB design with the skills in performance tuning
• Support existing data platforms and products in production for any critical issues and provide resolution fixes
• Have good communication skill, and collaborate well with different teams/stakeholders and vendors
• Knowledge of Azure based data storage & processing services, devops would be a Plus
• Knowledge in Spark based data engineering solutions using Databricks and Unity Catalog
• Experience with containerization and orchestration technologies such as Docker and Kubernetes is a Plus
• Excellent work ethics with ability to work independently
• Experience in Banking Domain preferred

What we value

These skills will help you succeed in this role

• Experienced, fully competent in own area and working global team
• Shares own expertise with others; will co-ordinate activities of others/the team
• Completes own role independently or with minimal supervision/guidance
• Strong written & verbal communication skills. Experience writing, reviewing technology documents including user guides.

Education & Preferred Qualifica