Sr Cloud Data engineer

Company

Federal Reserve Bank of San Francisco

We are the Federal Reserve Bank of San Francisco—public servants with a mission to advance the nation’s monetary, financial, and payment systems to build a stronger economy for all Americans. We are a community-engaged bank, and are committed to understanding and serving the vibrant, expansive communities of the Twelfth District. We respect people for what they do and for who they are. We build opportunities to learn and grow. We empower our people to balance their life and work responsibilities. That’s why we offer a flexible hybrid work model that allows you to collaborate with office colleagues on some days, and work from home on others.

The Federal Reserve Bank of San Francisco is looking for a Lead Cloud Data Engineer to join the Data and Analytics Service (DAS) Team. We are a team based out of San Francisco that partners with business lines across the Federal Reserve System to deliver the cloud + big data solutions and advanced analytics products.

The successful candidate will design, implement, and manage cloud-based data and AI solutions, ensuring scalable, secure, and repeatable data pipelines. The ideal candidate will have a strong background in data engineering, cloud infrastructure, scripting languages, and excellent analytical and communication skills.

Essential Responsibilities:

• Builds next-generation AI & analytics framework developed on a group of core technologies.

• Lead multi-functional teams in designing and implementing cloud-based data and AI solutions.

• Ensure data pipelines are scalable, secure, and repeatable.

• Collaborate with stakeholders to understand business requirements and turn data into insights.

• Develop and maintain cloud infrastructure, including data lakes, warehouses, and analytics platforms.

• Implement data governance and security best practices.

• Acts as a role model, thought leader, and change management for new software and technology throughout the company.

• Works on multiple projects as a technical team member driving business requirements end to end

• Takes end to end accountability of all data products and solutions.

• Leads training bootcamps, & cross training workshops for internal & stakeholders.

• Participates in pilots, Proof of Concepts and research on future data technologies and industry trends.

Qualifications:

• Bachelor’s degree in computer science, Information Systems, or other related technical field or equivalent work

• Must be a U.S. Citizen or a Green Card holder with the intent to become a U.S. Citizen

• Individuals who need immigration sponsorship now or in the future are not eligible for this position.

• Typically requires 7 or more years of experience in data engineering, data science, and software engineering.

• Advanced knowledge of Amazon Web Services (AWS) and cloud infrastructure

• Strong programming skills in Java or Python, or Scala

• Design, build, and maintain machine learning data pipelines.

• Experience in developing an end-to-end AWS native platform for building Data lakes (S3, Glue (Crawlers, ETL, Catalog), IAM, CodePipeline, CodeCommit, CloudFormation/Terraform, CloudTrail, CloudWatch, AWS Config, Guard Duty, Secrets Manager, KMS, EC2, Data Visualization Tool: Tableau run on an EC2 or AWS Quicksight), Athena, AWS AI (Bedrock, SageMaker, Q)

• Experience in Ansible/Terraform/Cloud Formation scripts and Infrastructure as Code scripting is required.

• Experience in Continuous Integration, Continuous Delivery, and Continuous Deployment software tools to support, enhance and grow our CI and CD capabilities.

• Experience in Databricks, Alteryx, Collibra etc.,

Desired Skills:

• Background in data security, governance and cybersecurity solutions.

• Domain experience in HR, Information Security, Finance, Business as IT

• Experience with and/or working knowledge the Financial Industry, Government Agencies, Federal Reserve Bank Lines of Business (LoBs) Applications

• Experienced in implementing AI, Data and Advanced Analytics solutions, and SaaS or related experience in the Cloud.

• Hands on experience in Generative AI implementation and optimization (HuggingFace, GPT, NLP, LLM)

Base Salary Range: Min: $138,900 - Mid: $180,400 - Max: $221,900 (Location: San Francisco)

Final salary and offer will be determined by the applicant’s background, experience, skills, internal equity, and alignment with market data.