Data Engineer

Data Engineer
Summary
This role requires a versatile individual who can handle both the technical aspects of data engineering, as well as the soft skills needed to work effectively in a team and communicate with business stakeholders. You should be comfortable with the entire data lifecycle, from gathering requirements to deploying data solutions.
Requirements

• 4+ years of experience in Data Engineering or similar role.
• Proven experience with AWS Cloud services.
• Excellent problem-solving and analytical skills.
• Strong communication and teamwork abilities.
• Ability to work with various file formats.
• Understanding of the software development lifecycle.
• Understanding of Agile methodologies.
• Experience with data storage and management of large, heterogeneous datasets including formats, structures, and cataloging with Iceberg, Parquet, Avro, ORC, S3, HFDS, HIVE, Kudu, or others.
• Experience with transformation and modeling tools including SQL-based transformation frameworks and orchestration, as well as quality frameworks including dbt, Apache NiFi, Talend, AWS Glue, Airflow, Dagster, Great Expectations, Oozie, and others.
• Experience working in Big Data environments including Hadoop and Spark.
• Experience working in Cloud Platforms including AWS, Google Cloud Platform, or Azure.
• Experience with streaming and stream integration or middleware platforms, tools, and architectures including Kafka, Flink, JMS, or Kinesis.
• In-depth programming knowledge of SQL, Python, R, Java, Scala, or equivalent.

This is a remote 6-month plus Contract opportunity with our MN client. 100% Paid employee Medical/Dental Benefits, Paid time off, Paid Holidays, and 401(k) (with immediately vested company match) available with TriCom during the contract period. H1-B Visa sponsorship is not available for this position. No third-parties, please.