Jobs and Careers
EG
Cloud File Storage Engineer
EgenRemote, Western USRemotefull_timeVerifiedPosted 19 Feb 2025
About the role
About Egen:
Egen is a fast-growing and entrepreneurial company with a data-first mindset. We bring together the best engineering talent working with the most advanced technology platforms, including Google Cloud and Salesforce, to help clients drive action and impact through data and insights. We are committed to being a place where the best people choose to work so they can apply their engineering and technology expertise to envision what is next for how data and platforms can change the world for the better. We are dedicated to learning, thrive on solving tough problems, and continually innovate to achieve fast, effective results. If this describes you, we want you on our team.
Want to learn more about life at Egen? Check out these resources in addition to the job description.
-> Meet Egen -> Life at Egen-> Culture and Values at Egen-> Career Development at Egen
About the opportunity:
We are seeking a highly skilled and motivated Cloud File Storage Engineer to join our team and developscalable file storage solutions for cloud-based High Performance Computing (HPC) platforms. Theideal candidate will have a strong background in both traditional parallel filesystems such as GPFS andLustre, and also modern cloud-native storage solutions such as S3, EFS, FSx, and ElastiCache. Youshould be comfortable with Amazon Web Services concepts and services, infrastructure as code, andcontinuous integration/continuous deployment (CI/CD) pipelines.
As a Cloud File Storage engineer, you will play a crucial role in designing, building, and maintaining thestorage infrastructure that supports life sciences research initiatives. You will collaborate withcomputational scientists and other engineers to ensure that our platform is robust, scalable, andcapable of handling complex computational workloads. You will also ensure our solutions areimplemented securely, with appropriate controls to allow safe storage of sensitive data. You willcollaborate with additional cloud platform technical and product leads to ensure your solutions alignwith other emerging infrastructure capabilities being developed concurrently for the R&D organization.
Fully remote and offshore candidates are welcome however this role requires working during US westcoast standard working hours (9-5pm PST/PDT).
Egen is a fast-growing and entrepreneurial company with a data-first mindset. We bring together the best engineering talent working with the most advanced technology platforms, including Google Cloud and Salesforce, to help clients drive action and impact through data and insights. We are committed to being a place where the best people choose to work so they can apply their engineering and technology expertise to envision what is next for how data and platforms can change the world for the better. We are dedicated to learning, thrive on solving tough problems, and continually innovate to achieve fast, effective results. If this describes you, we want you on our team.
Want to learn more about life at Egen? Check out these resources in addition to the job description.
-> Meet Egen -> Life at Egen-> Culture and Values at Egen-> Career Development at Egen
About the opportunity:
We are seeking a highly skilled and motivated Cloud File Storage Engineer to join our team and developscalable file storage solutions for cloud-based High Performance Computing (HPC) platforms. Theideal candidate will have a strong background in both traditional parallel filesystems such as GPFS andLustre, and also modern cloud-native storage solutions such as S3, EFS, FSx, and ElastiCache. Youshould be comfortable with Amazon Web Services concepts and services, infrastructure as code, andcontinuous integration/continuous deployment (CI/CD) pipelines.
As a Cloud File Storage engineer, you will play a crucial role in designing, building, and maintaining thestorage infrastructure that supports life sciences research initiatives. You will collaborate withcomputational scientists and other engineers to ensure that our platform is robust, scalable, andcapable of handling complex computational workloads. You will also ensure our solutions areimplemented securely, with appropriate controls to allow safe storage of sensitive data. You willcollaborate with additional cloud platform technical and product leads to ensure your solutions alignwith other emerging infrastructure capabilities being developed concurrently for the R&D organization.
Fully remote and offshore candidates are welcome however this role requires working during US westcoast standard working hours (9-5pm PST/PDT).
Key Responsibilities:
- Design, implement, and maintain scalable and high performance file storage environments onAWS.
- Develop and manage infrastructure as code using tools such as Terraform and Ansible.
- Automate deployment pipelines and improve CI/CD processes using GitLab CI/CD.
- Collaborate with cross-functional teams to understand the computational needs of scientists and translate them into effective platform solutions.
- Monitor and optimize platform performance, ensuring reliability and scalability.
- Troubleshoot and resolve issues related to infrastructure, deployment, and application performance.
- Support data transfer teams' ingress and egress activities.
- Identify and advance collaboration opportunities with other product teams, such as integration with existing data movement and data catalog solutions.
Required Skills:
- AWS: Deep understanding of AWS services and best practices for building scalable, secure, and cost-effective cloud environments.
- DevOps: Proven experience with DevOps practices, including infrastructure as code (Terraform, Ansible), continuous integration, and continuous deployment (GitLab CI/CD).
- IAM: Prior experience integrating storage with common identity and access management solutions such as Active Directory and IAM Identity Center.
- Version Control: Proficiency with Git and experience managing code repositories.
- Storage Concepts: Expert level proficiency with POSIX file system and Network File Sy(NFS) semantics.
- Proficiency with POSIX I/O profiling for high performance / high througworkloads.
- Storage Platforms: Expert level proficiency in at least one high performance / parallel file sytem technology such as Weka, Lustre, GPFS, Ceph, or JuiceFS.
- Storage Reliability: Have a robust understanding of storage redundancy, availability, and durability principles to effectively balance performance objectives with critical measures to prevent unintended data loss.
- Cloud Storage Services: High proficiency with Amazon S3 object storage.
- Some prior experienwith AWS managed services for file storage, such as EFS, FSx for Lustre, or FSx for OpenZFS.
- Security: Knowledge of security best practices in cloud environments and experience implementing them.
P
Apply for this role
Generate a tailored application kit with a matched cover letter, interview prep, and CV highlights — in under 60 seconds.
Apply Now →Generate Application KitFree account required — sign up in 30s