Lead, Software Engineer Data Solution Architect (AWS)

Job Classification:

Technology - Engineering & Cloud

Are you interested in building capabilities that enable the organization with innovation, speed, agility, scalability and efficiency? The Global Technology team takes great pride in our culture where digital transformation is built into our DNA! When you join our organization at Prudential, you’ll unlock an exciting and impactful career – all while growing your skills and advancing your profession at one of the world’s leading financial services institutions.

Your Team

As a Lead Software Engineer on/in Data Management & Governance you will partner with product owners, tech leads, designers, engineers and delivery professionals to improve Data Management and Governance services.  You will code, test and debug new and existing applications as you implement capabilities to solve sophisticated business problems, deploy innovative products, services and experiences to delight our customers! In addition to advanced technical expertise and experience, you will bring excellent problem solving, communication and teamwork skills, along with agile ways of working, strong business insight, an inclusive leadership attitude and a continuous learning focus to all that you do.

The current work arrangement for this position is Hybrid and requires your on-site a minimum of 3 days/week in our Newark, NJ location. For those outside of the commutable Newark location, we are open to virtual work arrangements.

Here is What You Can Expect on a Typical Day

• Design and build scalable solutions and services in AWS, ensuring the solution meets business and technical requirements.
• Professional hands-on experience in developing extensible data pipeline and reusable data processors  using PySpark, Scala, Python in AWS Glue and Lambda functions.
• Architect and develop secure, robust cloud-based services, real-time APIs, service integrations, and automations using a microservice architectural style.
• Lead the Solution design and implementation of solutions using AWS services.
• Maintain proficiency and implement best practices in AWS development tools and standards.
• Define and deploy job monitoring, metrics, and logging systems on AWS.
• Implement continuous integration and deployment (CI/CD) pipelines.
• Ability to comprehend requirements, identify potential tools/services in the market, and conduct comprehensive assessments leading to an informed selection process.
• Ability to coach/interact other technical resources, enterprise architects and cloud architects with minimal guidance and effectively leverage diverse ideas, experiences, thoughts, and perspectives to the benefit of the organization.
• Ability to excel in both independent and collaborative team environments.
• Lead the troubleshooting and resolution of issues in development, test, and production environments.

The Skills & Expertise You Bring

• Expertise in architecture, designing and building scalable cloud-based application leveraging AWS services.
• Proven experience with services like EC2, ECS, Kong, ALB, SQS/SNS, Kinesis, RDS, S3, Lambda, Glue, DynamoDB, EMR, VPC, Route 53, CloudFormation\Terraform, CloudWatch, Dynatrace, IAM
• Experience in building scalable and stronger data pipelines to support data integration, data processing, data quality and monitoring.
• Experience in handling various hierarchical data structures and  file formats such as  parquet, Json and Avro files
• Strong knowledge of DevOps principles and methodologies and toolset experience in bitbucket/GitHub and Jenkins/Terraform in adopting CI/CD approach.
• Automate infrastructure provisioning and configuration management using as code, with experience in tools such as Terraform or CloudFormation.

Proficient in:

• Programming languages:  Python, PySpark / Scala is mandatory
• Database: PostgreSQL, DynamoDB, Redis, GraphDBs
• Architecture & Design Patterns:  Specialized in Microservices and Service-oriented Architecture (SoA) with a focus on building web service APIs using REST and SOAP protocols, and adept in handling JSON and XML data formats.
• Software security skills: Proficient in secure coding, web application security, and DevSecOps with a strong understanding of concepts like authentication, authorization, encryption, digital signature, JWT, SSL, web service proxies, firewall, SAML 2.0, OpenID Connect, and OAuth 2.0.
• DevOps Tools & Practices: Skilled in branching techniques and the use of platforms such as GitHub and Bitbucket; proficient in DevOps practices and tools, i