Data Engineer #00246

Title: Data Engineer #00246

State Role Title: Information Tech Spec III

Hiring Range: $100,000 - $125,000

Pay Band: 6

Agency: The Library of Virginia

Location: Library of Virginia Building

Agency Website: https://www.lva.virginia.gov

Recruitment Type: General Public - G

Job Duties

The Library of Virginia seeks a versatile and motivated Data Engineer to help reimagine, transform, and administer an improved data platform and information infrastructure, from ingest through access. This redesigned role will have the opportunity to collaboratively transform data practices at a 200-year-old cultural heritage organization and state agency with an eye towards the future.

The work will create efficiencies; improve staff information gathering, efficiency, and productivity; and enhance the Library’s data storage capacity. It will also support the development of applications that allow LVA staff and users to contribute to and interact with data and databases. The incumbent will manage security, optimize performance, and guide the evolution of legacy systems to meet changing and more complex modern requirements. They will perform database administration on new and existing systems across various platforms from design through performance tuning, data security, backup/recovery, and user management.

The ideal candidate will have broad, intermediate-to-advanced data engineering / database administration knowledge, with a strong background in data architecture and planning. They will have experience and comfort both leading and implementing technological change, stewarding projects from inception to completion. The incumbent will have a proven record in data pipeline processes and integration tools to collect, process, store, and deliver data from multiple formats in organized, accessible, user-friendly ways. They will have strong troubleshooting skills, the ability and desire to learn new technologies quickly, and experience collaborating with non-technical staff to translate their needs into actionable technical tasks. They will be comfortable supporting disparate applications and systems—multitasking on various initiatives— and will show a demonstrated ability to work collaboratively within a team.

Position Requirements:

· Technical Responsibilities:

· Perform initial and ongoing evaluations of existing data and database infrastructure with an eye towards modernization, sustainability, and customer service. Implement recommended changes as necessary.
· Ingest, process, transform, store and securely and accessibly deliver data for information sharing and decision-making.
· Analyze, design, develop, implement and maintain custom databases and other systems that collect, store, and process data efficiently.
· Migrate and combine large datasets from multiple formats/locations.
· Monitor databases and related systems to ensure optimized performance, data quality and security.
· Implement processes to validate data, ensuring accuracy and reliability.
· Document processes related to database design, configuration, and performance.
· Work closely with project managers, stakeholders and other technical staff to understand data requirements and ensure that the data infrastructure meets those needs.
· Review and analyze staff work procedures to identify strategies for automation.
· Envision, design and implement new systems to meet immediate and long-term needs of Library stakeholders.
· Serve as a database administrator, at present primarily MS SQL but with the possibility to change based on assessments.
· Assist with data conversion efforts, which includes working with developers to convert legacy access applications into a modern web format and working with external government entities to ingest custodial record transfers.
· Manage database upgrades for all SQL based systems (MS SQL 2016/2019/2022 [most prevalent], MySQL, PostgreSQL 15), as well as supporting system administration.
· Maintain and ultimately convert legacy Microsoft Access applications.
· Determine security measures to be taken to protect data integrity. This includes vulnerability remediation and working with internal/external auditors to ensure compliance with Virginia security standards.
· Adhere to