Data Architect

Job Description
Arthur Grand Technologies is currently seeking a highly motivated and skilled Data Architect for one of our clients
Position:
Data Architect (AWS, PySpark)
Location:
Wilmington, DE/ Jersey City, NJ
Duration:
Long Term Contract
Job Description:

12+ years of experience on client projects to deliver AWS, PySpark, Databricks based Data engineering Analytics solutions Build and operate very large data warehouses or data lakes ETL optimization, designing, coding, tuning big data processes using Apache Spark Build data pipelines applications to stream Create Scala/Spark jobs for data transformation and aggregation Produce unit tests for Spark transformations and helper methods Write Scaladoc-style documentation with all code Design data processing pipelines Scala (with a focus on the functional programming paradigm), Scalatest, JUnit, Mockito Embedded Cassandra Apache Spark 2.X Spark query tuning and performance optimization SQL database integration Microsoft, Oracle, Postgres, and/or MySQL
Experience working with DFS, S3, Cassandra, and/or DynamoDB.
Spark developer who knows how to fully exploit the potential of our Spark cluster and special emphasis to database development skills across Migration projects.
Thanks,
Afrah Faiza
Arthur Grand Technologies Inc
Arthur Grand Technologies is an Equal Opportunity Employer (including disability/vets)