Apply Now

Big Data Architect

Hybrid in Richardson, TX, US • Posted 1 hour ago • Updated 1 hour ago

Full Time

Hybrid

Depends on Experience

Fitment

Dice Job Match Score™

✨ Finding the perfect fit...

Job Details

Skills

Big Data
Spark
Scala / Python
Pyspark
Hive
Hadoop
Azure

Summary

Locations : Richardson, TX/ Bridgewater, NJ/Raleigh, NC /Charlette, NC /Phoenix, AZ / Houston, TX

Required Skill and Experience

Core development experience in below stacks:
Experience in Scala or Python or Spark or Hadoop application development
Experience in end-to-end implementation of projects using Cloudera Hadoop, Spark, Hive, HBase, Sqoop, Kafka, Elasticsearch, Grafana, ELK stack
Experience in AI-Powered Intelligent Data Integration & Transformation and also expertise in AI-powered data lakes
Proven experience in architecting and administering Snowflake, Azure, and Google Big Data platforms.
Strong understanding of cloud infrastructure, data integration, and analytics workflows.
Experience in Categorizing, cataloging, cleansing and normalizing of datasets
Hands-on experience with platform monitoring, automation, and DevOps tools.
Experience in managing hybrid environments (on-prem and cloud).
Excellent communication and leadership skills.
Knowledge of data governance, security, and compliance frameworks.
Technical Ability to build bespoke AI agents, multi-agent systems using Python and frameworks like LangGraph, LangChain to build applications tailored to nuanced, real-world business needs.
Build AI-assisted workflows (classification, enrichment, response generation, decision support) and Implement structured outputs, prompt pipelines, and reliability safeguard.

Preferred Skill and Experience

Sound Knowledge of Software engineering design patterns and practices
Experience with Ranger, Atlas, Tez, Hive LLAP, Neo4J, NiFi, Airflow, or any DAG based tools
Knowledge and experience with Cloud and containerization technologies: Azure, Kubernetes, OpenShift and Dockers
Planning and Co-ordination skills
Experience and desire to work in a Global delivery environment.
Ability to work in team in diverse/ multiple stakeholder environment.
A high degree of initiative and flexibility
High customer orientation
Excellent verbal and written communication skills

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10200946b
Position Id: 8961499
Posted 1 hour ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Lead Data Engineer

Plano, Texas

•

Today

Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you'll have the

Full-time

USD 179,400.00 - 204,700.00 per year

Lead Data Engineer - AWS

Hybrid in Dallas, Texas

•

Yesterday

We are seeking a Lead Data Engineer to play a critical role in big data engineering and analytics capabilities. This role will lead the design, development, and optimization of scalable data platforms, real time data pipelines, and analytics ready data products. As part of the Big Data Engineering and Analytics organization, this role will focus on enabling a modern data lake and data mesh architecture that supports high volume, high velocity, and high variety data across enterprise and platform

Easy Apply

Full-time

220000 - 250000

Software Engineer III - AWS Architecture

Plano, Texas

•

Today

Job Description We have an exciting and rewarding opportunity for you to take your software engineering career to the next level. As a Software Engineer at JPMorgan Chase within the AWM LOB, you serve as a seasoned member of an agile team to design and deliver large-scale trusted market-leading technology products in a secure, stable, and scalable way on AWS Cloud. You are responsible for designing, developing and deploying critical AWS based technology solutions across multiple technical area

Full-time

Data Engineer

Plano, Texas

•

Today

It's an exciting time to be a member of the Fisher Investments Technology Department. We're investing in the future of our firm's technology and are building our team to achieve global growth. We are looking for a Senior Data Engineer to support our Enterprise Data Management team. If you are looking for an opportunity to make a difference as we develop scalable and strategic solutions to support our global growth, we want to hear from you! The Opportunity: Fisher Investments is looking for a

Full-time

Search all similar jobs