Job Title: Data & Analytics Solutions Architect (Hadoop + Big Data)
Location: NJ/NYC/Dallas TX/Charlotte, NC
Employment Type: Full-time
Job Description:
Data & Analytics Solutions Architect (Hadoop + Big Data)
Must Have Technical/Functional Skills
14+ years of experience in Enterprise Data Architecture, Hadoop Ecosystem, Big Data Engineering, and Data Platform Modernization.
Strong hands-on expertise in Hadoop, HDFS, YARN, Hive, Spark, PySpark, Kafka, SQL, Python, Java, and Scala.
Experience designing and implementing large-scale Big Data and Data Lake architectures supporting analytics, reporting, and AI workloads.
Strong understanding of Hadoop platform architecture, including HDFS, YARN, high availability, cluster management, workload optimization, and scalability.
Expertise in batch and distributed data processing using Spark, Hive, HBase, and MapReduce frameworks.
Experience building data ingestion and streaming solutions using Kafka and Hadoop ecosystem tools.
Strong knowledge of Data Engineering practices, including ETL/ELT, data integration, data quality, metadata management, lineage, observability, and DataOps.
Experience with Data Lake, Data Warehousing, Enterprise Data Models, Master Data, and Data Governance frameworks.
Strong understanding of security and governance controls, including Kerberos, Ranger, encryption, privacy, auditability, compliance, and controlled data access.
Proven experience in architecture definition, HLD/LLD creation, migration planning, technical governance, production readiness, and performance optimization.
Experience supporting platform modernization, cloud adoption, solutioning, effort estimation, and client-facing technical discussions.
Good understanding of BFSI regulatory, security, privacy, resilience, and audit requirements.
Bachelors degree in Computer Science, Engineering, Information Systems, Data Management, or a related discipline.
Preferred certifications in Hadoop, Spark, Cloud Data Engineering, Enterprise Architecture, Data Management, Security, or Big Data Platforms.
Roles & Responsibilities
Engage with business and technology stakeholders to understand business objectives, data platform requirements, and modernization goals.
Define end-to-end architecture for Hadoop and Big Data platforms supporting analytics, reporting, and AI workloads.
Design scalable, secure, and high-performance Hadoop ecosystems using HDFS, YARN, Spark, Kafka, Hive, and related technologies.
Architect data ingestion, batch processing, streaming, and data lake solutions for enterprise-scale environments.
Define data models, data lake zones, governance frameworks, metadata management, lineage, and security standards.
Lead Hadoop modernization, migration, and platform optimization initiatives to improve performance, scalability, and operational efficiency.
Establish architecture standards, reusable frameworks, engineering best practices, and DataOps operating models.
Provide technical leadership across solution design, implementation, testing, migration, deployment, and production support activities.
Conduct architecture reviews, identify risks and dependencies, and guide teams on mitigation strategies and best practices.
Drive performance tuning, capacity planning, reliability improvements, and infrastructure cost optimization.
Collaborate with data engineers, platform teams, architects, vendors, and client stakeholders to deliver enterprise data solutions.
Support solutioning, RFP responses, effort estimation, technical presentations, and client workshops.
Mentor architects and engineers and contribute to hiring, capability development, and knowledge-sharing initiatives.
Develop reusable accelerators, reference architectures, implementation frameworks, and technical best practices for Big Data platforms.
Generic Managerial Skills, If any
Strong leadership and stakeholder management skills with the ability to work effectively across business, engineering, architecture, and delivery teams.
Excellent communication and presentation skills for technical, business, and executive audiences.
Strong problem-solving and consulting mindset with the ability to evaluate options and recommend practical solutions.
Ability to lead cross-functional and distributed teams in a collaborative environment.
High ownership, accountability, and attention to detail with a focus on quality delivery.
Strong planning, prioritization, and decision-making skills while managing multiple initiatives and stakeholders.
Experience mentoring architects and engineers and driving adoption of best practices.
Ability to proactively manage risks, dependencies, and escalations to ensure successful project delivery.
Strong client-facing experience supporting workshops, architecture reviews, solution presentations, and executive discussions.
Adaptability to work in fast-paced environments with evolving business and technology priorities.
