Overview
Skills
Job Details
Job role: Data Engineer
Duration: Contract
Location: Columbus OH and Jersey City, NJ
Job Description:
We are looking for a skilled Data Engineer with hands-on experience in AWS cloud services, Databricks, PySpark, and Splunk. The ideal candidate will be responsible for building and optimizing data pipelines, transforming large datasets, and enabling real-time monitoring and analytics.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines using PySpark and Databricks on AWS.
- Integrate data from various sources and ensure high-quality data processing for analytics and reporting.
- Collaborate with data scientists, analysts, and DevOps teams to support data initiatives.
- Implement monitoring and alerting solutions using Splunk for data pipeline health and performance tracking.
- Optimize data workflows for cost, performance, and scalability in cloud environments.
Skills Required:
- Strong experience with AWS (S3, EMR, Lambda, Glue, etc.)
- Expertise in PySpark and distributed data processing.
- Hands-on experience with Databricks for data engineering workflows.
- Proficiency in Splunk for log analysis and operational monitoring.
- Solid understanding of ETL/ELT pipelines and data modeling.
Applicant Consent:
By submitting your application, you agree to ApTask's () and , and provide your consent to receive SMS and voice call communications regarding employment opportunities that match your resume and qualifications. You understand that your personal information will be used solely for recruitment purposes and that you can withdraw your consent at any time by contacting us at or . Message frequency may vary. Msg & data rates may apply.