Big Data Engineer

Overview

On Site
Depends on Experience
Contract - W2

Skills

python
SQL
hive
spark
aws
bash
Data

Job Details

Hi,

Hope you are doing well

My name is Deepak Yadav and I'm a Recruiter at Prisa Consulting Solutions LLC. Our records show that you are an experienced IT professional with Big Data Engineer. This experience is relevant to one of my current openings.

Job Title: Big Data Engineer

Location: Plano, TX (Onsite)

Position: Contract Position

Local Candidate with Local DL

  • JOB DESCRIPTION:
    • Design and develop ETL (Extract, Transform, Load) processes and database systems.
    • Build tools for real-time and offline analytic processing.
    • Troubleshoot data and software issues to ensure data consistency, accuracy, and integrity.
    • Integrate large and complex data sets from various sources to enable data-driven business insights.
    • Translate business specifications into technical design and production-quality code.
    • Write complex programs, ad hoc queries, and reports, ensuring all deliverables are well-structured, documented, and reusable.
    • Collaborate closely with business partners to understand functional requirements and data needs.
    • Work with cross-functional technical and analytics teams to implement scalable and efficient data solutions.
    • Lead all phases of data solution development and provide technical input in project meetings.
    • Assess data quality, conduct rigorous testing, and ensure high accuracy in all deliverables.
    • Serve as a technical consultant to internal clients and guide junior data engineers, ensuring quality control.
    • Contribute to the development of data engineering standards and best practices across teams.
    • Participate in software testing, regression testing, and production deployment.
    • Coordinate with vendors to resolve technical issues and enhance software systems.
    • Participate in special projects and ad hoc assignments as required.
    Required Skills & Qualifications:
    • Strong technical expertise in:
      • Python, SQL, Hive, Spark
      • AWS / Cloud Computing (e.g., Elastic MapReduce, EC2, S3)
      • Bash / Shell Scripting
    • Proven experience writing production-quality code to create scalable and reliable data products.
    • Excellent understanding of data integration, data pipelines, and distributed data systems.
    • Strong ability to communicate technical concepts to non-technical audiences effectively.
    • Experience working within Agile delivery methodologies.
    • Ability to lead projects, mentor others, and maintain high standards of data quality and engineering practices.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.