Apply Now

Data Engineer (Ex-Capital One or Ex-Discover Financial)

Richmond, VA, US • Posted 1 hour ago • Updated 1 hour ago

Full Time

No Travel Required

On-site

Depends on Experience

Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

Python
PySpark
ETL
Data Pipeline development

Summary

Mody''''s looking for Data Engineers / Software Engineers with strong experience in Python, PySpark, ETL, and data pipeline development for the Capital One. The selected candidates will design, develop, and maintain scalable data processing solutions and support large-scale data engineering initiatives.

<>Need to work on Mody''''s payroll as W2 employee. Ex-Capital One or Discover Financial are mostly prefer.

Responsibilities

Develop and maintain scalable data pipelines using Python and PySpark.
Build and optimize ETL/ELT processes for large datasets.
Develop data ingestion, transformation, and integration workflows.
Work with structured and unstructured data from multiple sources.
Optimize Spark jobs and data processing performance.
Develop reusable and reliable data engineering components.
Troubleshoot pipeline failures and data quality issues.
Collaborate with Data Scientists, Software Engineers, and Business teams.
Participate in Agile development, code reviews, testing, and deployment.

Required Skills

3+ years of experience in Data Engineering or Software Engineering.
Strong programming experience with Python.
Hands-on experience with PySpark / Apache Spark.
Strong understanding of ETL/ELT and data pipeline development.
Experience working with SQL and relational databases.
Experience with data integration and transformation.
Good understanding of software development practices, Git, testing, and CI/CD.
Strong problem-solving and communication skills.

Preferred Skills

Experience with AWS, Azure, or Google Cloud Platform.
Experience with Snowflake, Databricks, Hadoop, Kafka, or Airflow.
Knowledge of cloud-based data platforms.
Experience with Docker and Kubernetes.
Experience working in Agile/Scrum environments.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10280536
Position Id: 9065346
Posted 1 hour ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Senior Data Engineer

Richmond, Virginia

•

Today

Senior Data Engineer Job Description CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces.Included in the S&P 500 Index, CoStar Group is on a mission to digitize the world'sreal estate, empowering all people to discover properties, insights and connections that improve their businesses and lives. We have been living and breathing the world of real estate information and online marketplaces for over 35

Full-time

USD 133,000.00 - 172,000.00 per year

Data Engineer

No location provided

•

Today

Join Mizuho as a Data Engineer! The IT Data team is responsible for design and development of Data products for the entire firm. The team is embarking on an ambitious new project/implementation. "DEAL". It is the abbreviation for "Data Exchange and Abstraction Layer". It's the next generation, Data Mesh based platform implemented in the Mizuho Azure Cloud on Databricks. Data Mesh is a decentralized data architecture where data is owned and managed by the domain-specific teams that produce the d

Full-time

USD 88,000.00 - 105,000.00 per year

Senior Data Engineer

Remote

•

20d ago

Summary About Us: Calsoft is an engineering-led digital product partner for global ISVs and tech-driven enterprises. Since 1998, weve helped customers build platforms, modernize systems, and scale with confidence, across cloud, AI, and connected ecosystems. With engineering roots in Silicon Valley and delivery strength in India, we operate at the intersection of product development, intelligent automation, and secure digital transformation. Senior Data Engineer Irvine, CA Remote Key Responsibi

Easy Apply

Full-time

125000 - 180000

Senior Data Engineer II

Remote

•

Today

Who we are Samsara (NYSE: IOT) is the pioneer of the Connected Operations Cloud, which is a platform that enables organizations that depend on physical operations to harness Internet of Things (IoT) data to develop actionable insights and improve their operations. At Samsara, we are helping improve the safety, efficiency and sustainability of the physical operations that power our global economy. Representing more than 40% of global GDP, these industries are the infrastructure of our planet, i

Full-time

USD 134,470.00 - 203,400.00 per year

Search all similar jobs

More jobs at Baanyan Software Services, Inc. in Richmond, VA