Senior Cloud Data Engineer (AWS / PySpark / Serverless)

  • Torrance, CA
  • Posted 1 day ago | Updated 3 hours ago

Overview

On Site
Hybrid
USD 90,501.00 per year
Contract - W2

Skills

ELT
Real-time
Data Processing
Distributed Computing
Data Extraction
Amazon SQS
Web Services
Mentorship
Collaboration
Web Applications
RESTful
Microservices
Amazon EC2
Amazon RDS
Remote Desktop Services
Debugging
Knowledge Sharing
Java
Software Development
Cloud Computing
Python
PySpark
Big Data
Extract
Transform
Load
Management
Amazon Lambda
Application Development
Node.js
API
SQL
NoSQL
Database
PostgreSQL
MySQL
MongoDB
Amazon DynamoDB
Amazon Web Services
Amazon S3
Virtual Private Cloud
Continuous Integration
Continuous Delivery
DevOps
Terraform
Version Control
Git
Agile
Data Warehouse
Dimensional Modeling
JSON
Apache Parquet
Apache Avro
Data Security
Privacy
Regulatory Compliance
HTML
Cascading Style Sheets
JavaScript Frameworks
React.js
AngularJS
Streaming
Amazon Kinesis
Apache Kafka

Job Details

** The quickest way to be considered for this role is to CALL US directly! Click "Apply On Web" or "Apply Now" to access our Recruiter s contact details and give us a call today! **

===
** We will NOT accept 3rd Party (C2C) Contractors **
===

JOB DETAILS:
Position:Senior Cloud Data Engineer (AWS / PySpark / Serverless)
JOB REF#:43883 - JIH5JP00003893
Duration:12+ Months (On-Going Contract)
Location:HYBRID - Torrance, CA 90501
Pay Rate:$70.00 - $74.00 per hour (W2 Only)

HYBRID: Must be able to work ONSITE 4 days a week (LOCAL CANDIDATE ONLY)

RESPONSIBILITIES INCLUDE:
Design, develop, and maintain robust ETL/ELT pipelines using AWS Glue for large-scale data processing
Build serverless applications and microservices using AWS Lambda for real-time and batch data processing
Implement data transformation logic using PySpark for distributed computing on large datasets
Develop and optimize SQL queries for data extraction, transformation, and loading processes
Implement Infrastructure as Code (IaC) using AWS CloudFormation, CDK, or Terraform
Design event-driven architectures using AWS services, such as EventBridge, SQS, and SNS
Develop RESTful APIs and web services using Node.js for data access and integration
Mentor junior developers and provide technical guidance to the team
Collaborate with data scientists, analysts, and stakeholders to understand requirements
Participate in code reviews and maintain high coding standards
Document technical designs, processes, and best practices
Develop and maintain web applications using Node.js, Java, and Python. Design and implement RESTful APIs and microservices. Experience with AWS services (EC2, S3, Lambda, RDS, etc.).
Write clean, maintainable, and efficient code while adhering to best practices. Troubleshoot and debug applications to ensure optimal performance.
Participate in code reviews and contribute to team knowledge sharing. Proficiency in Node.js, Java, and Python.

REQUIRED EXPERIENCE/SKILLS:
5+ years of Software Development experience with 3+ years in Cloud environments
Strong proficiency in Python with extensive experience in PySpark for big data processing
Hands-on experience with AWS Glue for ETL pipeline development and management
Proven expertise in AWS Lambda for serverless application development
Solid understanding of Node.js for API development and backend services
Experience with SQL and NoSQL databases (PostgreSQL, MySQL, MongoDB, DynamoDB)
Proficiency in AWS services including S3, IAM, CloudWatch, and VPC
Experience with CI/CD pipelines and DevOps practices
Understanding of Infrastructure as Code tools (CloudFormation, CDK, Terraform)
Familiarity with version control systems (Git) and agile development methodologies
Strong understanding of data warehousing concepts and dimensional modeling
Experience with data formats (JSON, Parquet, Avro, ORC) and data serialization
Understanding of data security, privacy, and compliance requirements
Strong understanding of front-end technologies (HTML, CSS, JavaScript, frameworks like React or Angular).

DESIRED SKILLS:
Knowledge of data streaming technologies (Kinesis, Kafka) is a plus

==
==

Calance Consultant Benefits Offerings:
- EPO/PPO Medical Plans
- HMO/PPO Dental programs
- Vision - VSP (Vision Plan Summary)
- 401K Retirement vesting program (VOYA)
- Paid Bi-Weekly/Direct Deposit
- Flex Spending Plan
- Voluntary Life, AD&D, STD or LTD plans
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.