Data Engineer - Big Data Warehouse

  • Atlanta, GA
  • Posted 5 hours ago | Updated 5 hours ago

Overview

Remote
On Site
USD 65.00 - 68.00 per hour
Contract - W2
Contract - Independent

Skills

Warehouse
Supply Chain Management
Meta-data Management
User Guides
Data Flow
Data Lake
Real-time
Data Analysis
Collaboration
Data Quality
Databricks
PySpark
Data Management
Big Data
Data Marts
SQL
Data Architecture
Data Integration
Talend
Scripting
Data Manipulation
Business Intelligence
Master Data Management
Mobile Device Management
XML
SOA
Web Services
Data Science
Data Processing
Data Warehouse
Analytics
Java
Apache Hadoop
Apache Spark
Amazon Web Services
Electronic Health Record (EHR)
Amazon EC2
Amazon Redshift
Amazon S3
Python
Bitbucket
Git
Linux
Jenkins
Continuous Integration
Continuous Delivery
Computer Science
PostgreSQL
MySQL
Project Management
Communication
Finance
Accounting
Marketing
Legal
Customer Support
Online Training
Artificial Intelligence
Insurance
.NET

Job Details

Description

Job Summary

We are seeking a hands-on Data Engineer to design, code, and deliver Big Data Warehouse solutions. The ideal candidate is passionate about technology, thrives under pressure, and excels in collaborative environments. This role involves working closely with product owners, technical stakeholders, and cross-functional teams to deliver high-impact data solutions.

Key Responsibilities
  • Design and develop scalable Big Data Warehouse solutions across the data supply chain
  • Implement metadata management solutions
  • Create and maintain technical and user documentation (data models, dictionaries, glossaries, process/data flows, architecture diagrams)
  • Extend and enhance the enterprise Data Lake
  • Solve complex data integration challenges across multiple systems
  • Design and implement real-time data analysis and decisioning strategies
  • Collaborate with stakeholders to support data quality initiatives
  • Partner with Data Science teams to enhance actionable insights
  • Continuously learn and adopt new technologies


Requirements

Required Skills
  • Databricks
  • PySpark
  • Spark
  • Spark Cluster Configuration

Experience & Qualifications
  • Strong background in data management and access (Big Data, Data Marts, Data Warehousing)
  • Proficient in SQL, Spark SQL, and DataFrames
  • Familiarity with Redshift, Spark, Hadoop, and web services for data-driven decisioning
  • Experience in data architecture, governance, and security
  • Hands-on experience with data integration tools (e.g., Talend preferred)
  • Skilled in scripting for data manipulation
  • Exposure to Business Intelligence, MDM, XML, SOA/WebServices
  • Familiarity with Data Science tools and technologies
  • Bachelor's or Master's degree in Computer Science, Data Processing, or related field
  • Proven experience in Data Warehousing or similar analytics environments
  • Java programming and framework development experience
  • Experience with Hadoop, Spark, and AWS (EMR, EC2, Aurora, Athena, Redshift, S3)
  • 2+ years of Python experience
  • Proficient with Bitbucket and Git
  • Comfortable working in Linux environments
  • Familiarity with Jenkins and CI/CD pipelines
  • Strong understanding of core computer science concepts
  • Experience with Postgres and MySQL
  • Excellent organizational and project management skills
  • Outstanding communication skills


Technology Doesn't Change the World, People Do.

Robert Half is the world's first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.

Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app and get 1-tap apply, notifications of AI-matched jobs, and much more.

All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information.

2025 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking "Apply Now," you're agreeing to Robert Half's Terms of Use.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Robert Half