Senior Data Engineer- CoStar Real Estate Manager- Atlanta, GA

Senior Data Engineer- CoStar Real Estate Manager- Atlanta, GA

<br>

Job Description

<br>

Senior Data Engineer

Company Description

CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces. Included in the S&P 500 Index and the NASDAQ 100, CoStar Group is on a mission to digitize the world’s real estate, empowering all people to discover properties, insights and connections that improve their businesses and lives. 

We have been living and breathing the world of real estate information and online marketplaces for over 35 years, giving us the perspective to create truly unique and valuable offerings to our customers. We’ve continually refined, transformed and perfected our approach to our business, creating a language that has become standard in our industry, for our customers, and even our competitors. We continue that effort today and are always working to improve and drive innovation. This is how we deliver for our customers, our employees, and investors. By equipping the brightest minds with the best resources available, we provide an invaluable edge in real estate. 

CoStar Real Estate Manager is the leading Software as a Service Provider, (SaaS), to the Real Estate Industry. Please visit our website at: http://www.costar.com/products/costar-real-estate-manager to learn more about our product and growing company. 

Job Description

CoStar Real Estate Manager is growing quickly and we’re looking for a Data Engineer to help accelerate our growth. This role will be responsible for helping build out sitewide tracking architecture, and then feeding that data into AWS leveraging RDS, SQL Replication and Postgres for providing day to day insights on consumer behavior. You will engineer various aspects of our data management, ranging from designing and maintaining automated data infrastructure and creating BI solutions to facilitating data access and analysis for key company teams.

This position is located in Atlanta, GA and offers a hybrid schedule of 3 days onsite, 2 days remote.

Responsibilities

• Integrating data from multiple source systems.
• Developing and maintaining ETL/ELT processes.
• Collaborating with analytics team, data scientists and business analysts to ensure that data is available and accessible.
• Develop, maintain, and optimize data pipelines to ensure efficient data flow and transformation.
   
• Set up and manage data storage solutions including Amazon S3, Postgress, RDS, and DynamoDB.
   
• Implement data partitioning, indexing, and backup strategies to ensure data integrity and performance.
   
• Ensure data consistency and integrity across different systems.
   
• Implement data quality checks and validation processes to ensure the accuracy and reliability of data.
   
• Establish and enforce data governance policies and procedures.
   
• Monitor and optimize the performance of data pipelines and storage solutions.
   
• Troubleshoot and resolve performance issues to ensure the scalability and efficiency of data workflows.
   
• Design and implement ETL processes using Databricks and AWS services.

Basic Qualifications

• Bachelor’s Degree required from an accredited, not for profit university or college, with degree preferably in Computer Science, Data Science, or related field. MSc or PhD is a plus.
• A track record of commitment to prior employers.
• A demonstrable record of accomplishment of building and launching successful products that use terabytes of data.
• 5+ years of data pipeline engineering experience and deep database engineering experience.
• Ability to analyze technical requirements and design new architectures, data models and ETL/ELT strategies.
• Experience with SQL Server replication from on-prem to AWS
• Proficiency in AWS services including S3, Postgress, RDS, DynamoDB, SNS, Lambda, and General network topography.
• Proficiency in Databricks
• Strong programming skills in Python
• Experience with SQL and database management.
• Familiarity with DevOps practices and tools such as Docker, Kubernetes, and CI/CD pipelines.

Preferred Qualifications

• Proficiency in programming languages such as Python, R, and SQL.
• Performance tuning of database queries (SQL, Snowflake, Databricks) .
• Proficiency in data modeling techniques.
• Experience with No-SQL databases (e.g. Postgres).
• Experience with data pipeline tools (e.g. DMS, SQL Replication, Terraform, Lambda).
• Exper