Overview
Skills
Job Details
Title: Sr. AWS Data Engineer Location: Malvern, PA (Onsite) Position: Contract
Desired:
Worked on Big Data engineering and serverless technologies in AWS such as Lambda, Confluent Kafka, Glue, Step Functions, S3, RDS, Dynamo DB, Athena, Cloud Formation templates,
Cloud Watch Logs, Splunk, Ansible, etc.
Experience with SQL and scripting languages and platforms such as Spark, Python, R, SQL, JSON, XML, Parquet, and Avro.
Functional knowledge of marketing platforms (Adobe, Salesforce Marketing Cloud, Unica/Interact) and related data (good to have)
Responsibilities:
Design, Build & Deploy automated CI/CD pipelines
Understand existing pipelines
Design and develop semantic data models for activation and analytical use cases
Document data structures, including metadata within Collibra
Ensure data quality and optimizes data availability.
Enable greater reliability, adaptability, and speed by leveraging techniques from SRE and DevSecOps practices
Manage Security operations in Cloud Environment.
Responsible for configuring and automating applications in AWS instance.
Responsible of all aspects for Infrastructure management
Schedule and automate jobs