Senior Data Engineer

Company Description

A best-in-class city that attracts best-in-class talent, Philadelphia is an incredible place to build a career. From our thriving arts scene and rich history to our culture of passion and grit, there are countless reasons to love living and working here. With a workforce of over 30,000 people, and more than 1,000 different job categories, the City of Philadelphia offers boundless opportunities to make an impact. 
As an employer, the City of Philadelphia values inclusion, integrity, innovation, empowerment, and hard work above all else. We offer a vibrant work environment, comprehensive health care and benefits, and the experience you need to grow and excel. If you’re interested in working with a passionate team of people who care about the future of Philadelphia, start here.

What We Offer:
•    Impact - The work you do here matters to millions. 
•    Growth - Philadelphia is growing, why not grow with it? 
•    Diversity & Inclusion - Find a career in a place where everyone belongs.
•    Benefits - We care about your well-being.
 

The Office of Innovation & Technology (OIT) is the central IT agency for the City of Philadelphia headed by the Chief Information Officer (CIO). OIT oversees all major information and communications technology initiatives for the City of Philadelphia - increasing the effectiveness of the information technology infrastructure, where the services provided are advanced, optimized, and responsive to the needs of the City of Philadelphia’s businesses, residents, and visitors. OIT responsibilities include: identifying the most effective approach for implementing new information technology directions throughout city government; improving the value of the city’s technology assets and the return on the city’s technology investments; ensuring data security continuity; planning for continuing operations in the event of disruption of information technology or communications services; and supporting accountable, efficient and effective government across every city department, board, commission and agency.

Job Description

Data Engineering at the City is a unique opportunity for meaningful, exciting work and professional development using state-of-the art technologies and software development best practices. The data engineer will develop an intimate understanding of the City’s diverse data and contribute to improving the City’s data engineering infrastructure, pipelines, models, and accessibility for the public. 

The data engineer will be part of the GIS and Business Intelligence (GIS/BI) team working on behalf of the Department of Licenses and Inspections (L&I).  The GIS/BI team are responsible for all data extraction and analysis coming out of L&I whether it be visual, spatial, or tabular data.  The candidate responsible for developing and maintaining data integrations between L&I’s externally managed data warehouse, various departmental data visualization tools, and external departments and agencies through OIT’s central data warehouse (DataBridge) and managing the underlying infrastructure. 

Primary tools used include Python, Oracle, Postgres, Jenkins, Git/GitHub, Bash, PowerShell, Metabase, and SAS API providers, such as ArcGIS Online and Carto.  

Essential Functions:

• Work with business partners of varying technical ability to understand how their data is produced, stored, and updated, designing enhancements when needed
• Manage automated extract, transform, and load (ETL) workflows, including standardization and enriching of datasets that pass through DataBridge and L&I’s departmental database
• Write descriptive and accurate technical documentation of systems and applications
• Design, develop, and refine data pipelines using Jenkins, custom Python-based software, and other tools to connect diverse systems of record, centralized databases, and SaaS environments
• Other duties as assigned

Competencies:

• Clear and concise writing and communication skills.
• Creative problem-solving and critical thinking.
• Ability to work with data from diverse domains.
• Efficient time management and the ability to manage multiple workflows simultaneously.
• Ability to seek innovative opportunities and continuous improvement.

Knowledge and Skills:

• Intermediate to advanced SQL (Oracle and/or Postgres)
• Experience building and maintaining data pipelines/ETLs
• Proficient with Python
• Understanding of Git/GitHub for version control
• Experience with cloud services, including Jenkins
• Experience with command line interfaces, including PowerShell
• Experience managing spatial data in a data pipeline

Abilities:

• Reason about and work with complex datasets.
• Maintain clean and secure data environments.