Data Engineer/Architect

Overview

Remote
Depends on Experience
Contract - W2
Contract - 6 Month(s)

Skills

Data Engineer
Python
SQL
SPARK/SPARK SQL
Data Pipeline

Job Details

AVA Consulting is seeking a Data Engineer/Architect

Location: Remote

U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. We are unable to sponsor at this time.

Job Description:

As a Data Engineer, you will be responsible for designing and implementing data pipelines and architectures that support the collection, transformation, and analysis of data. You will work closely with Technology and Products Teams to ensure data understanding, security methods assigned and accessibility.

Responsibilities:

  • Data Pipeline Development: Build and maintain scalable data pipelines using Python, SQL, and SPARK/SPARK SQL to ensure efficient data processing and transformation.
  • Collaborative Innovation: Participate in brainstorming sessions and contribute ideas to our Technology, Algorithms, and Products Teams.
  • Project Management: Estimate engineering efforts, prioritize projects, plan implementations, and effectively triage production issues.
  • Information Aggregation: Aggregate information from various sources and build relationships with key partners to gather necessary data.
  • Requirements Gathering: Capture business and application requirements from the product management team and user feedback.
  • Data Analysis: Analyze and study existing data structures to identify technical details required to meet functional requirements.
  • Design Documentation: Create design documents detailing technical aspects of new features, including backend service requirements, data manipulation, and user interfaces.
  • Code Quality: Identify defects in existing systems and perform code refactoring to improve performance and maintainability.
  • Testing: Write unit test cases for data processing functions, perform local testing, and cover edge cases using mock networking tools.
  • Code Review: Conduct code reviews to reduce code coupling and enhance code quality and consistency.
  • Deployment Preparation: Prepare for product shipping by merging changes with existing applications and building a beta version for review by the product management team.

Requirements:

  • Technical Skills: Proficiency in Python, SQL, and SPARK/SPARK SQL.
  • Experience: Demonstrated experience in data engineering.
  • Communication: Strong ability to capture and relay business and application requirements.
  • Problem Solving: Skilled in analyzing technical details and identifying solutions for functional requirements.

NOTE: Interested Candidates can apply by sending their Updated Resume and Contact Details.

Ron Tolson

AVA Consulting

Fax:

Web:

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.