Sr. Software Integration Backend Engineer - Artificial Intelligence #1420

About the client

The client is a software company founded to address the fundamental disconnect between people and the companies they interact with every day. We give people a strong, collective voice to share experiences, inform companies, and influence change in our world.

Project Description

We are looking for a Senior Software Integration Engineer to join our team. This position is for world-class engineer who wants to take location, online and transactional data understanding to a new frontier. We need to integrate data from multiple AWS clouds, build new data classification algorithms and visualizations, publish our segments on different DMPs and DSPs and generate analytical reports.

Responsibilities

• Design, and develop data-products, with adjoining data-pipelines, engineered to high standards of performance, efficiency, and reliability.
• Formulate data-management strategy and data-warehouse architecture to provide single source-of-truth datasets for internal and external clients.
• Ensure data quality, with testing on a product and pipeline level.
• Implement automation of the data pipelines & software releases.
• Collaborate with internal teams to gather requirements for data-products.
• Provide some ongoing support, monitoring, and maintenance of deployed products.

Must have

• Integration of back- and front-end modules with Rest API.
• Build and Deployment of application on all environments. (AWS preferred, GCP ok, Azure as a last resort)
• Professional development experience with Python
• Experience with services like EMR & ECS on AWS (if they have AWS cloud experience. if not, no problem)
• Experience in UNIX/Linux environments with Bash/Python scripting.
• Experience with distributed systems: EMR, Hbase, Cassandra, and RDBMS (PostgreSQL).

Nice to have

• Spark development experience.
• Ruby development experience.
• Scala development experience.
• Experience with Scala is highly desirable.