Apply Now

Senior Data Engineer

Irving, TX, US • Posted 8 hours ago • Updated 8 hours ago

Full Time

No Travel Required

On-site

$130,000 - 135000/yr

Rivago infotech inc

Fitment

Dice Job Match Score™

🛠️ Calibrating flux capacitors...

Job Details

Skills

Spark
Pyspark
Hadoop
GCP

Summary

Experienced Senior Data Engineer to support large scale data platform modernization initiatives within a regulated banking environment.

The role focuses on designing and building enterprise-grade in-house frameworks, supporting high-volume batch and CDC-based incremental processing using Cloudera platform, and enabling ongoing Google Cloud Platform (Google Cloud Platform) modernization efforts.

Technology & Skill Requirements

• Apache Spark (PySpark and/or Scala) in large-scale production environments

• Cloudera Hadoop ecosystem (HDFS, Hive, YARN, Spark on Cloudera)

• Strong SQL expertise with complex transformations, performance tuning, and reconciliation logic

• Enterprise RDBMS experience with Oracle and MS SQL Server

• Batch ingestion, incremental ingestion, and CDC processing patterns

• CDC concepts and tooling (tool-agnostic: GoldenGate, Debezium, or equivalent)

• Data merge, deduplication, watermarking, checkpointing, and SCD handling

• Google Cloud Platform services including Dataproc , Composer and Dataplex

• Hybrid on prem to cloud data architecture and migration patterns

• Metadata-driven framework development and data quality validation techniques

• CI/CD pipeline implementation using enterprise tooling (GitHub Actions, Jenkins, DevOps)

• Git-based development workflows, code reviews, and automated testing practices

• Experience using Copilot or similar AI-assisted development tools safely and effectively in enterprise environments

• Logging, monitoring, alerting, and operational readiness practices

• Secure coding, access control, and compliance-aware development

• Documentation of design artifacts, runbooks, and operational procedures

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91131106
Position Id: 8979946
Posted 8 hours ago

Company Info

About Rivago infotech inc

Rivago Infotech Inc has been a leader in IT staffing and Software development for over 5 years and is one of the largest diversity and development firms in the industry. We are known for our high-touch, customer-eccentric approach, offering our clients unmatched quality, responsiveness and flexibility . We are appreciated by our clients for our streamlined execution, highly efficient service and exceptional talent management that go above and beyond traditional staffing services.

Go to company profile

Contact the job poster

Garima Rajput

Recruiter @ Rivago infotech inc

View Profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Sr. Data Engineer - SAP SD module

Remote

•

Today

About the role We are seeking aSenior Data Engineerwith strong expertise inSAP sales data domainsanddata warehouse development. The ideal candidate will have deep proficiency inSQL, hands-on experience working withSAP data as source (orders, shipments, backlog, invoices), and the ability to design and build robust data pipelines and models. Responsibilities : Design, develop, and maintain data pipelines for SAP sales data (orders, shipments, backlog, invoices)Translate SAP data structures into a

Easy Apply

Third Party, Contract

55 - 58

Data Engineer

Charlotte, North Carolina

•

Today

Required Skills & Experience Programming: Python/PySpark, Scala is a plus Big Data: Hadoop (HDFS, YARN), Hive, Spark (optimization, tuning) Orchestration: Apache Airflow Databases/ETL: MongoDB (indexing, sharding, tuning) SQL Server & SSIS (development, migration) Strong SQL & stored procedures Data Lake: HDFS, Hive, Parquet/ORC, partitioning, compaction APIs: REST-based ingestion Reverse engineering & lineage tools CI/CD & DevOps: Git, Jenkins, Docker, IaC Monitoring: logging, metrics, lineage

Easy Apply

Contract, Third Party

$55 - $60

Python Developer (with Google Cloud Platform)

Charlotte, North Carolina

•

Today

Core Technical Skills 8+ years ofback-enddevelopment experience. Advanced proficiency inPython(OOP, async, multithreading, libraries). Strong experience withGoogle Cloud Platform services, specifically: o Dataflow / Apache Beam o Cloud Functions o Cloud DLP o Cloud Composer (Airflow) o Pub/Sub o GCS & Big Query Experience with data pipelines, ETL/ELT frameworks, and distributed systems. Strong understanding of REST APIs and microservices architecture. Experience with CI/CD tools (Cloud Bui

Easy Apply

Contract, Third Party

58 - 60

Senior Developer/Lead

Hybrid in San Leandro, California

•

4d ago

Role:Senior Developer/Leads Location:San Leandro, CA(Onsite) Must have: Senior Developer/Leadswith Java, Python + Google ADK, comfortable working with LLMs, MCP, building Agents, generating code Role Summary: Design and build secure, scalable backend services in Java (Spring Boot) and Python, and deliver production-grade AI agent capabilities using Google Agent Development Kit (ADK). Build agentic workflows that can use tools, maintain session context/memory, and generate/refactor code with str

Easy Apply

Contract, Third Party

60 - 65

Search all similar jobs