Sr. Spark Architect

Overview

Remote
$140,000 - $180,000
Full Time

Skills

Master Data Management
Apache Hive
Apache Hadoop
Apache Kafka
Big Data
Apache Spark
Data Warehouse
Data Profiling
Shell
Data Integration
SQL
spark
scala

Job Details

Spark Senior Technology Architect
Newport, NJ

Required Qualifications:

At least 11 years of Information Technology experience
Must have deep experience in architecting Big Data solutions using Hadoop, Spark, Hive, Kafka, Scala
Must have in depth knowledge of hadoop ecosystem
Should have data background. Must have knowledge on data warehouse, ETL, reporting.
Good experience in end-to-end implementation of data warehouse and data marts
Experience and detailed knowledge with Master Data Management, ETL, Data Quality, metadata management, data profiling, micro-batches, streaming data loads
Experience designing and implementing complex solutions for distributed systems
Experience in leading and mentoring teams

Preferred Qualifications:

Good understanding of data integration, data quality and data architecture
Experience in Relational Modeling, Dimensional Modeling and Modeling of Unstructured Data
Strong knowledge and hands-on experience in SQL, Unix shell scripting
Good understanding of Agile software development frameworks
Strong communication and Analytical skills
Ability to work in teams in a diverse, multi-stakeholder environment comprising of Business and Technology teams
Experience and desire to work in a global delivery environment

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.