Lead Cloud Engineer

Company

Federal Reserve Bank of San Francisco

When you join the SF Fed, you join a team of people working together to foster an inclusive economy that works for everyone. From data-driven insights to cloud transformation, the information technology team moves the SF Fed forward. We use innovative technologies and Agile methods to positively impact every American across the communities we serve.

We empower our people to balance their life and work responsibilities. That’s why we offer a flexible hybrid work model that allows you to collaborate with office colleagues on some days, and work from home on others.

The Federal Reserve Bank of San Francisco is looking for a Lead Cloud Data Engineer to join the Data and Analytics Service (DAS) Team. We are a team based out of San Francisco that partners with business lines across the Federal Reserve System to deliver the cloud + big data solutions and advanced analytics products.

The successful candidate will design, implement, and manage cloud-based data and AI solutions, ensuring scalable, secure, and repeatable data pipelines. The ideal candidate will have a strong background in data engineering, cloud infrastructure, scripting languages, and excellent analytical and communication skills.

Qualifications

• Bachelor's or Master’s degree in Computer Science, Information Systems, or related field, or equivalent work experience
• 10+ years of experience in data engineering, data science, and software engineering.
• Advanced knowledge of Amazon Web Services (AWS) and cloud infrastructure
• Strong programming skills in Java, Python, or Scala
• Experience with data integration, ETL, and data visualization tools
• Excellent analytical, collaboration, critical thinking, and time management skills
• Experience in Continuous Integration, Delivery, and Deployment software tools to support, enhance, and grow our CI and CD capabilities.
• Working experience in Ansible/Terraform/Cloud Formation scripts and Infrastructure as Code scripting is required.
• Experience in developing an end-to-end AWS native platform for building Data lakes (S3, Glue (Crawlers, ETL, Catalog), IAM, CodePipeline, CodeCommit, CloudFormation (or Terraform), CloudTrail, CloudWatch, AWS Config, Guard Duty, Secrets Manager, KMS, EC2, Data Visualization Tool: Tableau run on an EC2 or AWS Quicksight), Athena
• Professional experience optimizing machine learning workflows and maintaining data pipelines
• Advanced knowledge of SQL and experience with relational databases
• Experience with Generative AI solution implementation.
• Experience with Data hubs, data lakes and warehouses.
• Experience in data security, governance, and cybersecurity solutions
• Experience with Databricks, Alteryx, Data integration, Data Masking tools, Access Management and Data Governance tools
• Real time streaming solutions
• Experience with Business Continuity, Disaster Recovery, Availability, Security for Data applications.
• Must be a U.S Citizen or a Green Card holder with intent to become a U.S Citizen

Responsibilities

• Lead cross-functional teams in designing and implementing cloud-based data and AI solutions.
• Ensure data pipelines are scalable, secure, and repeatable.
• Collaborate with stakeholders to understand business requirements and turn data into insights.
• Develop and maintain cloud infrastructure, including data lakes, warehouses, and analytics platforms.
• Implement data governance and security best practices.
• Stay up-to-date with industry trends and emerging technologies
• Sets standards and best practices, while encouraging other data engineers for input on possible ways to improve the system.
• Influences the design of innovative solutions using new technologies.
• Acts as a role model, thought leader, and change management for new software and technology throughout the company.
• Works on multiple projects as a technical lead
• Drives continuous improvements with focus on quality, stability, usability, maintainability and ultimately customer satisfaction.
• Takes end to end accountability of all data products and solutions.
• Leads training bootcamps, & cross training workshops for internal & stakeholders.
• Participates in pilots, Proof of Concepts and research on future data technologies and industry trends.

Desired Skills:

• Domain experience in HR, Information Security, Finance, Business as IT
• Experience with and/or working knowledge the Financial Industry, Government Agencies, Federal Reserve Bank Lines of Business (LoBs) Applications

Base Salary Range: Min: $155,700 - Mid: $202,200 - Max: $248,700 (Location: San Francisco)
Final salary and offer will be determi