Overview
On Site
Depends on Experience
Contract - W2
Contract - 12 Month(s)
Skills
DATA ENGINEER
AWS
GLUE
ICEBERG
Job Details
Position: AWS Data Engineer
Location: Toronto, ON(onsite)
Duration: 12+ Months Contract
JD
Essential Requirements(Must Have):
- Extensive experience with AWS data ecosystem services such as Lake Formation, EMR, Glue Catalog, EC2, and CloudWatch, including the configuration and optimization of these services for data processing, with a strong focus on security, scalability, and logging.
- Solid understanding and hands-on experience with open table formats, such as Hudi or Iceberg.
- Proven track record of coding and software development within high-performing data engineering teams, with a focus on delivering data products at scale.
- Demonstrated experience with cloud automation and deployment using tools like Terraform.
- Strong SQL and Spark skills for effective data transformation and processing.
- Ability to enforce and uphold data quality through validation, cleansing, and governance best practices to ensure data accuracy and consistency.
Preferred Qualifications (Nice to Have):
- Experience in the financial industry, particularly in investment banking.
- Knowledge of additional data processing libraries and tools.
- Expertise in one of the major real-time data processing frameworks, such as Apache Flink or Kafka Streams.
- Experience in building event-driven and/or streaming data services.
Education: At least a bachelor s degree (or equivalent experience) in Computer Science, Software/Electronics Engineering, Information Systems, or closely related field is required.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.