Big Data Engineer

  • Houston, TX
  • Posted 5 hours ago | Updated 5 hours ago

Overview

Hybrid
$40 - $60
Contract - Independent
Contract - W2

Skills

Amazon Lambda
Amazon Web Services
Python
Databricks
Testing
Big Data
bigdata

Job Details

Title - BIG DATA ENGINEER

Experience Range - 7-12 yrs. expr.

Location - Houston, TX (3 Days Onsite / Week) (Local Candidates will be Preferred)

Job type: Contract

Duration: 6+ Months

Work Status (Visa): (No 3rd party candidates, Candidate should be on your w2)

No. of Position: 1

Tentative start date: ASAP

Note - Interview will be In Person in Houston, TX

Must have skills :

AWS Glue, AWS Lambda, Databricks, Python (Expert)

Job Description :

The senior developer's role in this project will involve designing and implementing the following platform components:

  • Ingesting data
  • Processing and normalizing the data.
  • Distributing the data to different stakeholders.
  • Build and improve common framework including monitoring, CI/CD pipelines, testing, performance, resiliency, development practices and code quality
  • Maintain and support application in production Good knowledge of data structures / data modeling Activities- The main activities include:
  • Collecting, understanding, challenging, and refining business requirements and opportunities.
  • Designing solutions following architecture guidelines.
  • Leading development activities and contributing in a senior/expert role. Development activities involve building and maintaining efficient, reusable, and reliable code that adheres to high standards of software quality, design, and testing principles, while delivering solutions on time and within budget.
  • Supporting continuous improvement of services and applications by identifying bottlenecks, bugs, and providing solutions.
  • Delivering production-ready services to users with a focus on achieving the highest level of satisfaction.
  • Supporting the production phase, including delivering monitoring and alerting tools to minimize support impact during the development phase.
  • Writing and updating technical documentation in English and making it available to the team and partners.
  • Providing effective and timely communication to all relevant teams.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.