Apply Now

Data Engineer - (Apache Spark , Scala )

Dallas, TX, US • Posted 30+ days ago • Updated 22 hours ago

Full Time

No Travel Required

On-site

Depends on Experience

Fitment

Dice Job Match Score™

🧠 Analyzing your skills...

Job Details

Skills

Data Engineering
Big Data
Spark
Scala
Python
Data Processing
Data Quality
Extract
Transform
Load
SQL
Banking

Summary

Data Engineer ( Spark , Scala , Python )

Irving, TX

Full-Time

Seeking a Senior/Mid-Level Data Engineer with 5 to 10 years of experience skilled in Apache Spark, Scala and Python to design and implement scalable data processing solutions.

Job Description

Develop and maintain robust data pipelines using Apache Spark and Python Collaborate with data scientists and analysts to optimize data workflows.
Ensure data quality and integrity across large datasets.
Implement data transformations and aggregations for analytics and reporting Work with cross functional teams to integrate data solutions into existing systems
Monitor and troubleshoot data processing jobs to ensure reliability and performance
Stay updated with emerging technologies and best practices in big data and Python development

Roles and Responsibilities

Design develop and optimize scalable data processing applications leveraging Apache Spark
Write clean efficient and reusable Python code to support data engineering tasks.
Analyze complex data sets to identify trends and insights for business use
Collaborate with stakeholders to gather requirements and deliver data solutions that meet business needs
Mentor junior team members and contribute to knowledge sharing within the team
Participate in code reviews and ensure adherence to coding standards and best practices Manage data pipeline deployments and monitor their health in production environments

Thanks,

Aravindharaj

Newt Global LLC

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10119089
Position Id: 8898925
Posted 30+ days ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Big DATA Developer with Python

Irving, Texas

•

3d ago

About Us: LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700+ clients, LTIMindtree brings extensive domain and technology expertise to help drive superior competitive differentiation, customer experiences, and business outcomes in a converging world. Powered by nearly 9

Full-time

$83,912 - $128,080

Data Engineer

Dallas, Texas

•

2d ago

{"description": "Requisition ID: 257501 Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture. We are committed to investing in our employees and helping you continue your career at Scotiabank. We are looking for a hands on Data Engineer with deep expertise in Apache Spark and strong programming skills in Python, Scala, and Java. This role is centered on building high performance, scalable data pipelines and processing large datasets in a distribut

Full-time

Big Data Engineer/Big Data developer-Full time-Hybrid

Hybrid in Dallas, Texas

•

11d ago

We are looking for a Big Data Engineer with strong experience in building scalable data pipelines and working with large datasets using modern big data technologies. Key Responsibilities: Design and develop data pipelines using Apache Spark and Hadoop ecosystemProcess and analyze large-scale structured and unstructured dataBuild ETL workflows and optimize data processing jobsIntegrate data from multiple sources including APIs, databases, and streaming platformsEnsure data quality, reliability, a

Easy Apply

Full-time

Depends on Experience

Data Engineer

Dallas, Texas

•

18d ago

Python, Pyspark, Databricks, AWS cloud architecture,- Previous experience as a data engineer or in a similar role- Must have experience with AWS Python, Pyspark, AWS, Databricks, Lambda function services such as SQL Database, Python.- Knowledge of programming languages and environments such as Python, Java, Scala, R- Hands-on experience with SQL.- Great numerical and analytical skills- Degree in Computer Science, IT, or similar field; a Masters is a plusUnderstanding of ETL

Easy Apply

Full-time

Depends on Experience

Search all similar jobs