Greetings from Accion Labs,
Our direct Client is looking for Sr. AWS Data Engineer-6+ Months Contract-Remote opportunity-Direct Customer.
Primary Skills : Snowflake , Python ,AWS Glue , Lamda using Pyspark , SQL.
Job Description:
- Collaborate with cross-functional teams including Data Scientists, Analysts, and Engineers to gather data requirements and build scalable data solutions, including processing unstructured data for AI initiatives.
- Design, develop, and maintain complex ETL pipelines using AWS Glue, PySpark, and Databricks, ensuring efficient data processing across batch and streaming workloads.
- Integrate and manage data storage and retrieval using AWS DynamoDB and Snowflake, optimizing for performance and scalability.
- Ensure data integrity, quality, and security across data pipelines, applying best practices for encryption, IAM, compliance, and data governance (e.g., Atlan).
- Monitor and troubleshoot pipeline issues, manage production incidents (P1-P4) with thorough RCA, and continuously optimize for cost and performance across AWS services.
- Stay current with advancements in AWS Glue, PySpark, Databricks, and data infrastructure tools (including AI assistants like GitHub Copilot), and recommend improvements where applicable.
Experience / Minimum Requirements:
10+ years of experience as a Data Engineer, with strong hands-on expertise in AWS Glue, PySpark, AWS DynamoDB, Snowflake, and Databricks.
- Deep understanding of Spark architecture, distributed processing, and performance tuning techniques.
- Strong grasp of data modeling, schema design, and data warehouse concepts.
- Experience with AWS data ecosystem including S3, Lambda and Glue Catalog.
- Proficiency in Python (PySpark) for data transformation and automation tasks.
- Familiarity with CI/CD practices, infrastructure-as-code tools such as Terraform, data cataloging (Atlan), and legacy platform migration is a plus.
- Excellent communication and problem-solving skills, with the ability to work independently and in a team environment.
Education:
Bachelor s degree in computer science, information Systems, or related discipline.
This role is open to W2 or those seeking Corp-Corp employment.
The salary range for this role is 100-120 k/annum or Corp-Corp rates please contact the recruiter.
In addition to other benefits, Accion Labs offers a comprehensive benefits package, with Accion covering 65% of the medical, dental, and Vision Premiums for employees, their spouses, and dependent children enrolling in the Accion-provided plans.
Never miss an opportunity! Create an alert based on the job you applied for.
