AWS Data Engineer

Overview

Remote
$50 - $60
Contract - Independent
Contract - W2

Skills

Amazon Lambda
Amazon S3
Amazon Web Services
Cloud Computing
Databricks
IoT
Kubernetes
Terraform

Job Details

One of our clients is seeking a AWS Data Engineer to join the role immediately. Please share your resumes asap.

Key Responsibilities:

Pipeline Development & Integration:

  • Design, develop, and deploy data pipelines between cloud and industrial systems.
  • Use Kubernetes and Terraform to build scalable and fault-tolerant data workflows.
  • Integrate industrial systems using modern cloud technologies, ensuring efficient data exchange.

Cloud Infrastructure Management:

  • Utilize AWS services like Lambda functions, S3 buckets, and Databricks to build, manage, and optimize data solutions.
  • Maintain and enhance Databricks deployments, ensuring scalability and performance.
  • Manage and automate infrastructure-as-code deployments with Terraform.

IoT & Industrial Solutions:

  • Incorporate IoT data collection and processing into pipelines to enable industrial insights.
  • Collaborate with industrial engineers to streamline and secure integration with physical systems.

Database Operations:

  • Design and maintain relational and non-relational databases as part of integrated solutions.
  • Perform database monitoring, optimization, and troubleshooting to ensure uptime and performance.

Collaboration & Best Practices:

  • Work closely with software engineering, DevOps, and data science teams to deliver high-impact solutions.
  • Follow best practices in version control, CI/CD pipelines, and security compliance.

Desired Skills & Requirements:

Core Specializations:

  • Solid hands-on experience with AWS (Lambda, S3, Databricks, etc.).
  • Proficiency with Kubernetes for container orchestration and Terraform for infrastructure automation.
  • Strong understanding of creating, managing, and optimizing data pipelines in industrial environments.

Programming Expertise:

  • Proficiency in Python, especially in using it for building Lambda functions and pipeline scripts.
  • Experience with API integration for data exchange between systems.

Data Skills:

  • Knowledge of managing and querying databases (SQL and NoSQL technologies).
  • Exposure to big data environments and analytics tools.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.