Apply Now

Senior Batch Infrastructure Engineer

Dallas, TX, US • Posted 17 hours ago • Updated 17 hours ago

Contract Corp To Corp

Contract W2

Contract Independent

12 Months

No Travel Required

On-site

$60 - $75/hr

Fitment

Dice Job Match Score™

To see how well you match this job, please log in or create an account.

Once logged in, be sure to complete your profile to get the most accurate match score.

🔢 Crunching numbers...

Job Details

Skills

Amazon Web Services
Apache Pig
Apache Spark
Data Quality
Apache Hadoop
Apache Hive
Docker
DevOps
Data Warehouse
Python
Google Cloud Platform
Data Security
Java
Batch Processing

Summary

Job Summary:
We are seeking an experienced Senior Engineer, Analytics with a focus on Batching to join our team. As a Senior Engineer, you will play a key role in designing, building, and maintaining our batch processing infrastructure. You will work closely with our data scientists, product managers, and other engineers to develop and deploy scalable, efficient, and reliable data pipelines.

Responsibilities:

Design, develop, and maintain batch processing pipelines for large-scale data transformation and analysis using technologies like Apache Hadoop, Pig, Hive, Spark, or similar frameworks.
Experience with Airflow and/or Cloud Composer for workflow management and orchestration
Work with data scientists and product managers to develop and deploy data pipelines for data warehousing and data lake use cases
Collaborate with other engineers to integrate batch processing systems with our data streaming and real-time analytics infrastructure
Ensure data quality, data security, and data privacy across all batch processing systems
Develop and implement batch processing jobs using programming languages like Java or Python. (Experience with both is a plus)
Work with public cloud providers such as Google Cloud Platform (Google Cloud Platform), Amazon Web Services (AWS), or Microsoft Azure
Experience with Dataproc is a strong preference
Optimize batch pipelines for performance and resource efficiency.
Monitor and troubleshoot batch jobs to ensure successful execution and data quality.
Implement DevOps principles and practices to ensure efficient and reliable deployment of batch processing systems
Knowledge of containerization technologies such as Docker and Kubernetes

Requirements:

Bachelor's degree in Computer Science or a related field
5+ years of experience in software engineering, with a focus on batch processing and analytics
Strong programming skills in Java or Python
Experience with a public cloud provider, with a focus on Google Cloud Platform
Strong experience in batch processing systems such as Hadoop, Pig, Hive, and Spark
Experience with Dataproc is a plus
Knowledge of DevOps principles and practices
Understanding of containerization technologies such as Docker and Kubernetes
Excellent problem-solving skills, with the ability to work independently and collaboratively
Excellent communication skills, with the ability to explain complex technical concepts to non-technical stakeholders
Experience with machine learning and data science technologies is a plus
Certification in a public cloud provider or a relevant technology is a plus

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10462843
Position Id: 9135395
Posted 17 hours ago

Contact the job poster

Lingeshwaran Rajendran

Recruiter @ Photon

View Profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Data Analytics Lead Engineer

Irving, Texas

•

Today

Citi is looking for a Data Analytics Lead Engineer to design, build, and operate scalable data pipelines and cloud-based data architectures within our Lending business, spanning Mortgage and Personal Loans. This is a hands-on data engineering role where you will develop and maintain production-grade data systems - working across big data platforms, data lakes, and cloud infrastructure - that directly power lending analytics at scale. You will also bring an understanding of AI and ML integration

Full-time

USD 125,760.00 - 188,640.00 per year

Snowflake Architect

Hybrid in Richardson, Texas

•

16d ago

Role: AWS Data Engineer with DS skills Location: Cambridge, MA (Hybrid- once a week) Detailed JD: A hands-on AWS Data Engineer with Data Science skills designs, builds, and maintains scalable cloud data pipelines while operationalizing machine learning models and data science workloads. Job Description Overview Role: Hands-On AWS Data Engineer with Data Science Skills Core Mission: Bridge the gap between raw data infrastructure and production-ready machine learning by building reliable data

Easy Apply

Third Party, Contract

Depends on Experience

Data Engineer - Data Platform (Spark/Kafka/Flink/Scala/Java) - Onsite Hybrid

Dallas, Texas

•

Today

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Data Platform (Spark/Kafka/Flink/Scala/Java) - Onsite Hybrid to join our team in Dallas, Texas (US-TX), United States (US). Join a team building next-generation, cloud-native data platforms powering real-time and batch data movement at enterprise scale. Yo

Full-time

USD 96,492.00 - 144,738.00 per year

Data Engineer-Full Time- Onsite Role

Grand Prairie, Texas

•

30+d ago

About Company: We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work on a scale across all devices and digital mediums, and our people exist everywhere in the world (18000 plus experts across 40 countries, to be exact). Our work culture is dynamic and non-hierarchical. We are looking for great new colleagues. That is where you come in! Role: Data Engineer Location: Grand-Prairie, Texas 75

Easy Apply

Full-time

Depends on Experience

Search all similar jobs

More jobs at Photon in Dallas, TX