Overview
Skills
Job Details
Job Summary
We are looking for a highly skilled Data Engineer with strong Java backend development experience to support Capital One s enterprise data platforms. The ideal candidate will have expertise in data engineering, distributed systems, cloud-native development (preferably AWS), and building scalable APIs/services using Java.
Key Responsibilities
Develop, enhance, and maintain Java-based backend services and APIs to support data processing workflows.
Design and implement data pipelines, ETL processes, and data transformation solutions in a cloud environment.
Build and manage scalable data platforms using tools like Spark, Kafka, and AWS native services.
Optimize data flow, storage, and compute for high performance and low latency.
Work closely with product, analytics, and engineering teams to deliver robust data solutions.
Ensure data quality, governance, and security best practices across systems.
Support production issues, troubleshooting, and performance tuning.
Participate in Agile development practices including sprint planning, code reviews, and deployments.
Required Skills
Core Technical Skills
Java / Java 8+ (strong backend development experience)
Data Engineering frameworks Spark / Hadoop / Hive
Kafka / Event-driven architecture
SQL, NoSQL Databases
AWS Cloud S3, EMR, Lambda, Glue, ECS/EKS or similar
Experience building REST APIs and microservices
Strong understanding of CI/CD pipelines (Jenkins, GitHub, Maven, etc.)
Additional Preferred Skills
Python for data workflow automation
Terraform or CloudFormation (Infrastructure as Code)
Kubernetes & Docker
Experience in banking/financial domain is a plus (Capital One experience preferred)
Qualifications
Bachelor s degree in Computer Science, Engineering, or related field
7 10+ years of experience in software engineering/data engineering
Strong analytical, problem-solving, and communication skills
Ability to work in a fast-paced, enterprise-level environment