Data Architect (AWS ,Pyspark)

Company Description

Arthur Grand Technologies (www.arthurgrand.com) is in the business of providing staffing and technology consulting services. We have doubled our revenue year over year for the past 5 years. This speaks to the long-lasting relationship and customer satisfaction that we have built in this short span of time. Our company is managed by a team of professionals who worked for big 5 consulting firms for 20+ years. 

We are a minority owned staff augmentation and technology consulting company
To keep our valued employees, we need to keep them engaged in challenging, interesting work, offer market-relevant benefits and provide continued opportunities for professional growth.

Job Description

Arthur Grand Technologies is currently seeking a highly motivated and skilled Data Architect for one of our clients

Position: Data Architect (AWS, PySpark)

Location: Wilmington, DE/ Jersey City, NJ

Duration:Long Term Contract

Job Description:

12+  years of experience on client projects to deliver AWS, PySpark, Databricks based Data engineering Analytics solutions Build and operate very large data warehouses or data lakes ETL optimization, designing, coding, tuning big data processes using Apache Spark Build data pipelines applications to stream Create Scala/Spark jobs for data transformation and aggregation Produce unit tests for Spark transformations and helper methods Write Scaladoc-style documentation with all code Design data processing pipelines Scala (with a focus on the functional programming paradigm), Scalatest, JUnit, Mockito  Embedded Cassandra Apache Spark 2.x Spark query tuning and performance optimization SQL database integration  Microsoft, Oracle, Postgres, and/or MySQL

Experience working with DFS, S3, Cassandra, and/or DynamoDB.  

Spark developer who knows how to fully exploit the potential of our Spark cluster and special emphasis to database development skills across Migration projects.

Thanks,

Afrah Faiza

Arthur Grand Technologies Inc

Arthur Grand Technologies is an Equal Opportunity Employer (including disability/vets)

Additional Information

All your information will be kept confidential according to EEO guidelines.