Senior Database Engineer

Job Description

DOB’s Information Technology bureau is responsible for the data processing functions and operations of systems that provide operational, analytical and managerial support functions, as well as IT resource management for the agency. DOB IT develops and maintains application software for such systems. Working closely with owner/client bureaus within the agency, IT develops and implements both customized and packaged applications, and maintains the requisite technical infrastructure, using in-house project resources and hired consultants. We encourage innovation, creativity, and a think outside of the box attitude when solving complex problems and implementing new solutions.

The Department is in the process of the development, conversion and modernization of the agency's numerous old legacy systems. The Senior Database Engineer will serve as a Database Developer who will support DOB’s architecture team with consolidating and optimizing new technology initiatives for the agency’s mission critical systems.
Under general direction, with broad scope for the exercise of independent initiative and judgment, responsibilities include, but are not limited to:
- Supervising data engineering projects from beginning to end, including planning, designing, testing and implementation. Projects could include but not limited to the following:
o Extract, transform, and load (ETL) data warehouses, including the use of change data capture to load incremental changes from on premise data source to the cloud data warehouse.
o Optimize and tune complex SQL code for faster data retrieval and processing.
o Develop API that ingest data as well as share DOB agency data with external stakeholders
- Serving as a project leader for complex projects involving database systems and providing technical leadership and guidance to other development team members in the design, architecture, and best practices of data engineering solutions.
- Planning, designing, developing and implementing scalable database structures to support business requirements for anticipated data growth.
- Leading database design by working with development teams, coordinating with other developers, business team representatives, and others to accomplish the database design and documented specification.
- Developing SQL Server 2016 - 2022 T-SQL/Store Procedures/SQL Optimization and Tuning.
- Creating Complex Queries/Functions/Views/SQL jobs/Database Objects.
- Leveraging Python to call API to integrate data with our DOB data warehouse.
- Creating and maintaining end-to-end analytics solution in Azure Synapse, including creating Synapse pipelines to support Azure Data Lakes and Serverless and Dedicated Pools, which are used as data sources by our reporting systems, Power BI and Oracle Analytics.
- Deploying and troubleshooting SSIS Packages.
- Designing and implementing solutions for extraction and integration of data to and from a relational database or data warehouse for the purpose of reporting, decision support and analysis.
- Diagnosing and resolving database issues to maintain uninterrupted operations.
- Ensuring database optimization, data integrity, consistency, security and privacy is part of the application designs.
- Safeguarding data through robust security measures and regular audits.
- Implementing and managing backup and recovery protocols to prevent data loss.
- Monitoring database performance, implementing optimization strategies for increased efficiency.
- Collaborating with developers to implement database design in prototypes to help communicate database requirements to all interested parties and inform an iterative database design process with customer feedback.
- Reviewing developers’ queries and stored procedures to check for correct implementation of database design.
- Performing scheduled activities; recommending solutions or alternate methods to meet requirements.
- Developing data dictionary, system specification, guidelines and documentation.
- Implementing, maintaining and supporting a variety of reports utilizing various reporting tools.
- Assisting in development of standard reports for ongoing business needs.

CIVIL SERVICE STATUS:
Only permanent Computer Specialists (Software), applicants who are reachable on the Computer Specialist (Software) open competitive list, and applicants as indicated below will be considered. If the list is exhausted, applicants who passed the most recent open competitive exam for Computer Specialist (Software) may also be considered.

Candidates who are permanent in comparable civil service titles may be considered for title change under rule 6.1.9 of the Personnel Rules and Regulations of the City of New York.

REMOTE WORK:
This position may be eligible for remote work up to 2 days per week, pursuant to the Remote Work Pilot Program.