Overview
Skills
Job Details
Notes:
Looking for candidates already local to McLean, VA or Richmond, VA
Role will be hybrid 3 days onsite & 2 days remote.
Looking for previous Capital One experience
Job Description:
We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Data Engineer, you ll have the opportunity to be on the forefront of driving a major transformation within Capital One.
What You ll Do:
Primary Responsibility: Operation support of the Data Pipeline running in the production environment meeting the required SLA.
Support & Enhance the next generation Distributed Data Pipelines using programming languages like Python
Be part of a group of engineers building data pipelines using big data technologies (Spark, Snowflake, AWS Big Data Services like Glue) on medium to large scale datasets
Work in a creative & collaborative environment driven by agile methodologies with focus on CI/CD, Application Resiliency Standards, and partnership with Cyber & Security teams
Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
Collaborate with digital product managers, and deliver robust cloud-based solutions.
Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
Preferred Skills: AWS (EMR, EC2, Glue, Lambda, S3), Spark, Python, Databricks(nice to have)
3+ years of experience in application development including Python, SQL
2+ years of experience with a public cloud (AWS)
3+ years experience with Distributed data computing tools (Spark)
3+ years of experience with UNIX/Linux including basic commands and shell scripting
2+ years of experience with Agile engineering practices
2+ years of experience with Incident Management