Arity - Big Data Engineer

At Allstate, great things happen when our people work together to protect families and their belongings from life’s uncertainties. And for more than 90 years our innovative drive has kept us a step ahead of our customers’ evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection. 

Job Description

Arity is a part of the Allstate Corporation, which means we have the same innovative drive that keeps us a step ahead of our customers’ evolving needs. We collect and analyze enormous amounts of data in order to provide cutting-edge solutions to companies invested in transportation.

The Engineering Team
Our engineers are fueled by a passion to impact the future of mobility. They push the boundaries of telematics and transportation tech by creating and supporting cutting-edge products. As part of an Agile team, they are armed with the freedom to innovate and the opportunity to see projects through from start to finish. Using a variety of languages and a top-notch technology stack, our engineers make critical advances in areas like sensor technology, enterprise engineering and platform development. Our team understands what it means to collaborate and communicate in an interconnected global team, all while having trust, transparency and empathy for the end user. Which is pretty cool, if you ask us.

The Role:

The Data Engineer role is responsible for processing data into and out of the Arity insurance platform.  This will include taking over existing pipelines, converting them to a new platform, as well as taking on some processing that pulls data together and then store in data lakes.

Responsibilities:

• Collaborate with other Engineers, IT Architects, and business clients to ensure complete understanding of the platforms technical and business functionality.  

• Participate in daily site, cross-site, and product team ceremonies associated with scrum principals

• Establish continuous integration, continuous delivery, and continuous deployment pipelines and practices

• Design, develop, and test components of the new attribute platform including data ingestion and delivery functions

• Test, debug, and analyze performance and document hardware and software technology components. 

• Ensure that plans integrate effectively with other components accounting for compliance and security standards. 

• Rotate into production support of applications which could include off-hours support. 

• Participate in knowledge sharing and contribute to the overall growth of the collective knowledge of the team. 

Qualifications:

• 3+ experience with building big data ETL pipelines

• Strong understanding of computer science concepts, big data design principles and implementing and managing large data sets.

• Experience in Test Driven Development; including knowledge and experience in testing frameworks (such as MSTest, NUnit, xUnit.net, junit, mockito, jasmine, protractor, cucumber, and other like technologies) 

• Understanding of cloud services, deployment models, and distributed systems

• AWS services knowledge: S3, Lambda, Firehose, Dynamo DB, and Step Functions

• GCP services knowledge: Big Query, GCS

• Experience in Python and/or Scala

• Clear understanding of data management, process automation, system monitoring, and maintainability. 

At Arity, great things happen when our people work together. 

That’s why when you join our team, we make sure it isn’t just a job — it’s an opportunity. One that takes your skills and pushes them to the next level. One that encourages you to challenge the status quo. And one where you can impact the future for the greater good.    

You’ll do all this in a flexible environment that embraces connection and belonging. And with the recognition of several inclusivity and diversity awards, we’ve proven that Allstate empowers everyone to lead, drive change and give back where they work and live.  

  

Good Hands. Greater Together

Skills

Big Data, Big Data Engineering, Big Data Systems, Big Data Technologies, Data Engineering, Data ETL, Data Ingestion, Data Science, Google BigQuery, Influencing Others

Compensation

Compensation offered for this role is $85,600.00 - 152,650.00 annually and is based on experience and qualifications.

The candidate(s) offered this position will be required to submit to a background investigation.