Overview
Skills
Job Details
Role: Big Data Engineer
Location: Alpharetta, GA (Hybrid, locals only)
Duration: 12+ Months
Must have:
Java
Python
Apache Spark
Responsibilities:
Design, build, and optimize scalable data pipelines and ETL
workflows.
Develop high-performance distributed data processing applications
using Java / Python.
Build and optimize complex Spark applications for large-scale data
transformations.
Work with Hadoop ecosystem tools such as HDFS, YARN, Hive, HBase,
etc.
Implement performance tuning and troubleshooting on Spark and
distributed data systems.
Ensure data reliability, quality, and efficient flow across systems.
Collaborate with Data Scientists, Architects, and Platform engineers
for data solutions.
Manage large, structured, semi-structured, and unstructured
datasets.
Implement data ingestion using batch and streaming pipelines.
Work with cloud Big Data platforms (AWS / Azure / Google Cloud Platform) for
development and deployment.
Requirements:
Bachelors or masters degree in computer science, Engineering, or
equivalent
4 to 8 years of relevant experience in Big Data and distributed
systems
Strong programming expertise in Java and/or Python
Advanced hands-on experience with Apache Spark (DataFrames, Spark
SQL, tuning, job optimization)
Strong understanding of Hadoop ecosystem, distributed computing
concepts, and HDFS
Experience building scalable ETL pipelines
Experience with version control, CI/CD, and DevOps workflows
Hands-on experience working on data processing on cloud platforms
Nice-to-Have:
Kafka / streaming data pipelines
NoSQL DB experience (Cassandra, MongoDB, HBase, etc.)
Knowledge of containerized deployments (Docker, Kubernetes)
Experience with Airflow, Luigi, or orchestration tools
Thanks
Lokesh Vaishnav
Technical Recruiter | Empower Professionals
........................................................................................................................................................
|
100 Franklin Square Drive Suite 104 | Somerset, NJ 08873
Certified NJ and NY Minority Business Enterprise (NMSDC)