Staff Data Engineer

Job Description

The Role

The Marketing Applied Sciences team is responsible for developing analytics-driven solutions to help GM Marketing Organizations achieve their business goals. The Staff Data Engineer role is responsible for designing, developing and maintaining data pipelines, databases and data infrastructure to enable the efficient data collection, storage and analysis in support of marketing strategies. This role requires collaboration with data scientists, data infrastructure architects and data consumption stakeholders to ensure the availability of high-quality data for insights and decision making is available and will deliver value to the GM strategic vision for the future and meet prioritized business needs.  This role drives to deliver innovative solutions with technical fidelity and thrives to work effectively across a cross-functional data and stakeholder ecosystem. 

What You’ll Do

• ​Design, construct, install and maintain data architectures, including database and large-scale processing systems. 
• Develop and maintain ETL (Extract, Transform, Load) processes to collect, cleanse and transform data from various sources inclusive of cloud. 
• Design and implement data pipelines to collect, process and transfer data from various sources to storage systems (data warehouses, data lakes, etc).
• Implement data protection using encryption, secure key management, and access controls to ensure compliance with data privacy regulations. 
• Build data solutions that ensure data quality, integrity and security through data validation, monitoring, and compliance with data governance policies.
• Administer and optimize databases for performance and scalability.
• Automate performance monitoring by capturing execution time, memory usage, and cost metrics, and surface insights through a real-time dashboard. 
• Maintain Master Data, Metadata, Data Management Repositories, Logical Data Models, and Data Standards.
• Troubleshoot and resolve data-related issues affecting data quality fidelity.
• Document data architectures, processes and best practices for knowledge sharing across the GM data engineering community.
• Participate in the evaluation and selection of data related tools and technologies.
• Collaborate across other engineering functions within EDAI, Marketing Technology, and Software & Services.
• Provide domain-specific thought leadership by researching emerging data trends and technologies, and guiding technical teams through knowledge sharing, best practices, and strategic insights. 

Your Skills & Abilities (Required Qualifications) 

• 7+ years of hands-on experience. 
• Bachelor's degree (or equivalent work experience) in Computer Science, Data Science, Software Engineering, or a related field.  
• Strong understanding and ability to provide mentorship in the areas of data ETL processes and tools for designing and managing data pipelines.
• Proficient with big data frameworks and tools like Apache Hadoop, Apache Spark, or Apache Kafka for processing and analyzing large datasets. 
• Hands on experience with data serialization formats like JSON, Parquet and XML.
• Consistently models and leads in best practices and optimization for scripting skills in languages eg. Python/ Java/ Scala, etc for automation and data processing. 
• Proficient with database administration and performance tuning for databases like MySQL, PostgresSQL