Sr. Data Engineer and Analyst - Artificial Intelligence-driven RNA Foundry (AIRFoundry) - Penn Engineering

University Overview

The University of Pennsylvania, the largest private employer in Philadelphia, is a world-renowned leader in education, research, and innovation. This historic, Ivy League school consistently ranks among the top 10 universities in the annual U.S. News & World Report survey. Penn has 12 highly-regarded schools that provide opportunities for undergraduate, graduate and continuing education, all influenced by Penn’s distinctive interdisciplinary approach to scholarship and learning. As an employer Penn has been ranked nationally on many occasions with the most recent award from Forbes who named Penn one of America’s Best Large Employers in 2023.

Penn offers a unique working environment within the city of Philadelphia. The University is situated on a beautiful urban campus, with easy access to a range of educational, cultural, and recreational activities. With its historical significance and landmarks, lively cultural offerings, and wide variety of atmospheres, Philadelphia is the perfect place to call home for work and play.

The University offers a competitive benefits package that includes excellent healthcare and tuition benefits for employees and their families, generous retirement benefits, a wide variety of professional development opportunities, supportive work and family benefits, a wealth of health and wellness programs and resources, and much more.

Posted Job Title

Sr. Data Engineer and Analyst - Artificial Intelligence-driven RNA Foundry (AIRFoundry) - Penn Engineering

Job Profile Title

Application Architect

Job Description Summary

The AIRFoundry, a new center for AI-driven discovery and synthesis of RNA, seeks an experienced data engineer and backend software architect, to build the core of AIRFoundry’s knowledge sharing platform, KAIR. KAIR develops and adapts novel AI and database technologies to facilitate task-driven search capabilities over datasets – including Retrieval Augmented Generation, data lake search, large language models, and novel AI and ranking algorithms. KAIR also incorporates numerous cloud and open-source technologies, including open-source database and vector indexing.

The core of KAIR will build upon the Pennsieve data platform for biomedical data sharing, which is widely used for managing scientific data for multiple Penn and external projects. The position involves working closely with the Pennsieve engineering team, and will jointly report to Prof. Joost Wagenaar in the Perelman School of Medicine. A key element of the position will be to develop capabilities for combining local Penn high-performance computing and data storage resources with the Pennsieve cloud platform, and incorporating search components from open source and from research collaborations.

Job Description

Job Responsibilities

• Perform backend data engineering and software development for supporting data search and analysis on Penn computing resources, with master data synchronized with the Pennsieve platform developed by the Wagenaar Lab.

• Integrate with open-source indexing, database, and search services, such as Lucene, PostgreSQL, ChromaDB, Neo4J and LlamaIndex – and/or equivalent technologies developed by the AIRFoundry research team.

• Develop technical design documents based of functional requirements; manage development tickets and task specifications and development strategy