Overview
Hybridcandidate should be in office 3-4 days a week
Depends on Experience
Contract - W2
Contract - 6 Month(s)
Skills
AWS
Python
Data Engineer
EMR
Glue
Job Details
Role : Senior Data Platform Engineer
Location: New York, NY
Contract Position
Overview:-
We are looking for a skilled Senior Data Platform Engineer with a strong Python background to join our Data team. This role is ideal for a data engineering professional experienced in delivering robust data platforms and implementing data fabric solutions. As a Senior Data Platform Engineer, you will be instrumental in building and optimizing the data infrastructure on AWS for our customers, ensuring high performance, data integrity, and secure access across data products.
Required skills:
AWS (EMR, Glue Catalog),
Hudi (preferred) or Iceberg,
Python or Spark or Scala,
Terraform
Extensive experience with AWS data ecosystem services such as Lake Formation, EMR, Glue Catalog, EC2, and CloudWatch, including the configuration and optimization of these services for data processing, with a strong focus on security, scalability, and logging.
Solid understanding and hands-on experience with open table formats, such as Hudi or Iceberg.
Proven track record of coding and software development within high-performing data engineering teams, with a focus on delivering data products at scale.
Demonstrated experience with cloud automation and deployment using tools like Terraform.
Strong SQL and Spark skills for effective data transformation and processing.
Ability to enforce and uphold data quality through validation, cleansing, and governance best practices to ensure data accuracy and consistency.
Education: At least a bachelor s degree (or equivalent experience) in Computer Science, Software/Electronics Engineering, Information Systems, or a closely related field is required for the project
Location: New York, NY
Contract Position
Overview:-
We are looking for a skilled Senior Data Platform Engineer with a strong Python background to join our Data team. This role is ideal for a data engineering professional experienced in delivering robust data platforms and implementing data fabric solutions. As a Senior Data Platform Engineer, you will be instrumental in building and optimizing the data infrastructure on AWS for our customers, ensuring high performance, data integrity, and secure access across data products.
Required skills:
AWS (EMR, Glue Catalog),
Hudi (preferred) or Iceberg,
Python or Spark or Scala,
Terraform
Extensive experience with AWS data ecosystem services such as Lake Formation, EMR, Glue Catalog, EC2, and CloudWatch, including the configuration and optimization of these services for data processing, with a strong focus on security, scalability, and logging.
Solid understanding and hands-on experience with open table formats, such as Hudi or Iceberg.
Proven track record of coding and software development within high-performing data engineering teams, with a focus on delivering data products at scale.
Demonstrated experience with cloud automation and deployment using tools like Terraform.
Strong SQL and Spark skills for effective data transformation and processing.
Ability to enforce and uphold data quality through validation, cleansing, and governance best practices to ensure data accuracy and consistency.
Education: At least a bachelor s degree (or equivalent experience) in Computer Science, Software/Electronics Engineering, Information Systems, or a closely related field is required for the project
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.