Lead Data Engineer

About FlexGen

Based in Durham, N.C., FlexGen is a leading integration services and software technology provider for energy storage solutions in the United States and globally. FlexGen designs and integrates storage solutions and the software platform that enables today’s energy transition. Leveraging its best-in-class energy management software and power electronics, FlexGen delivers utility-scale storage projects integrated with traditional and renewable power generation globally. The Company’s clients and partners include the most technically and commercially demanding developers, utilities, government agencies, and industrial companies in the world.

Energy storage represents a multibillion-dollar market at the center of the energy transition. The integration of energy storage requires software and technological solutions that play a critical role in the adoption of renewables at scale—offsetting the intermittent and reliability challenges that renewable power generation creates for the grid. Since its founding in 2009, FlexGen has supported deployments of more than 1.2 GWh of energy storage systems across the U.S. and internationally for utility, microgrid, and C&I customers. The Company’s proprietary software platform allows energy storage owners to deploy various power market strategies and combine storage solutions with any form of generation.

FlexGen is dedicated to providing best-in-class service and performance for its customers, ensuring safety, reliability, and resiliency in all operating environments. FlexGen supports the customer across the full journey of developing an energy storage project and leverages decades of engineering and software expertise to maximize the value that its customers ultimately receive. The company’s HybridOS solutions include six distinct energy management solution applications: DigitalTwin, FlexPack, SiteController, FleetManager, PowerCloud, and FlexBidr.

Position Description

FlexGen makes software that makes a difference in the world. With HybridOS our customers can put more battery storage on to the grid quicker and easier and then keep it running effectively. Traditional energy management systems are often custom developed from the ground up each time a customer builds a project. FlexGen applies modern technologies and product development principles to deliver software that gets the job done, is easy to learn and a joy to use. 

We are looking for an experienced Data Engineer to architect, implement, and maintain our diverse data infrastructure. The ideal candidate will have a strong background in cloud services and experience working with large-scale data processing systems. You will be responsible for designing and implementing data pipelines, ensuring data quality, and optimizing data processing performance. You will work closely with our data science and web development teams to deliver valuable insights and be a crucial part of our data-driven strategy. 

Major Job Responsibilities:

Architect, troubleshoot, and maintain a scalable, reliable, and cost-effective data infrastructure designed to move large timeseries datasets in near-real time for various end uses 

Ensure data quality and integrity through continuous data validation, monitoring, and anomaly detection 

Optimize data processing performance by leveraging best practices, such as data partitioning, compression, and caching 

Develop and maintain data catalog and schema management systems to facilitate data discovery and governance 

Collaborate with the team to establish proper software development lifecycle (SDLC) processes, including version control, code reviews, and continuous integration 

Mentor and provide guidance to junior team members, fostering a culture of collaboration and continuous learning 

The technologies you may use for this role include:

• On-premises databases: InfluxDB, PostgreSQL 
• Data formats: Parquet 
• Message brokers: MQTT 
• AWS services: Lambda, Glue, Timestream, RDS, Data Lake 
• Experienced in one or more of the following languages: SQL, Python, Go, Rust 
• ETL/ELT processes 
• Data modeling and warehousing concepts 

Position Requirements:

Bachelor's or Master's degree in Computer Science, Engineer