Only on W2
The following requirement is open with our client.
Client : TCS
Title : AWS Data Engineer
Location : San Francisco. CA
Duration : 12 Months
Rate : $65/hr on W2
Relevant Experience :
Detailed Job Description:
We are seeking a skilled AWS Data Engineer to design, build, and manage scalable cloud-based data platforms and pipelines. The ideal candidate will have strong experience in AWS data services, distributed data processing, and infrastructure automation.
Job Responsibilities:
· Design and manage AWS-based data infrastructure using services such as S3, Glue, EMR, Redshift, Athena, Lambda, Kinesis and RDS.
· Build and maintain scalable, fault-tolerant data pipelines (batch and streaming) Implement Infrastructure as Code (IaC) using Terraform Cloud Formation.
· Optimize data storage, compute and query performance for cost and efficiency.
· Ensure data security, governance and compliance (IAM, encryption, VPC, logging).
· Design and implement monitoring, alerting and observability for data platforms and pipelines.
· Integrate and manage monitoring tools such as Datadog, Prometheus, Grafana, Cloud Watch Create dashboards, alerts and SLIs SLOs to ensure pipeline reliability and performance.
· Collaborate with data engineers, analysts and platform teams to support analytics use case.
· Automate deployments, scaling and operational tasks via CICD pipelines.
· Participate in architecture reviews and recommend best practices for AWS data platforms.
· Proficiency in Python SQL (Scala optional) Solid understanding of data modelling, ETLELT and distributed systems.
· Experience with Apache Spark, EMR, Kafka.
· Hands on with AWS Kendra would be good.
· Experience with Data Lake.
· Familiarity with Airflow, Step Functions or other orchestration tools.
Must Have Skills:
AWS Data Lake (S3), Terraform IaC, EMR Spark Clusters, AWS Glue ETL, Redshift / Athena, Kinesis Streaming, Airflow Orchestration, Datadog Observability.
Thanks and Regards,
Goutham Eluri
Technical Recruiter
ASCII Group LLC.
38345 W. 10 Mile Rd, Ste.#365; Farmington, MI 48335
Office:
Email: Website: