Senior Data Engineer

Responsibilities:

• Create and maintain optimal data processing pipeline architecture
• Build the infrastructure required for optimal extraction, transformation, and loading of data using SQL and big data technologies
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics
• Interpret data, analyze results using statistical techniques and provide ongoing reports 
• Identify, analyze, and interpret trends or patterns in complex data sets
• Work with stakeholders including the Executive, Engineering, and Operation teams to assist with data-related technical issues and support their data infrastructure, analysis, and reporting needs
• Keep our data secure through multiple data centers and AWS regions

Required Skills:

• MS in Computer Science, Electrical Engineering, or related field
• 3+ years of software engineering experience
• Good oral and written communication skills
• Expertise in Python, SQL, microservices, databases, data pipelines
• Technical expertise regarding data models, database design and development, data mining and segmentation techniques
• Experience with large scale data processing, e.g. MapReduce, Spark, Kafka
• Experience with AWS core technologies such as EC2, RDS, EMR, S3 and Lambda
• Extensive software design and development skills. Ability to learn and adapt to new technologies and contribute in a productive environment.
• Strong knowledge of and experience with reporting packages

Preferred Skills:

• Experience with deep learning frameworks (e.g. TensorFlow, PyTorch); 
• Experience working with autonomous vehicles or robotics.