Senior Data Engineer

  • Columbia, SC
  • Posted 2 days ago | Updated 2 days ago

Overview

Hybrid
Depends on Experience
Contract - W2
Contract - Independent

Skills

Python
Spark
CloudFormation
Lambda
CloudWatch
TypeScript
Glue
AWS Services
big data

Job Details

Key Responsibilities:

  • Review and analyze systems to streamline processes to ensure efficient, consistent use of all resources and adjusting designs to maximize reusability and reduce costs across subsystems
  • Provide technology solutions and prototypes to be used as the basis or template for more complicated business/technical requirements
  • Research, diagnose, and develop fixes for defects in existing code
  • Address maintenance issues related to current development, testing, and production

Skills & Qualifications:

  • 8 years of application development, systems testing or other job-related experience
  • Experience in big data technologies
  • Experience in cloud-based technologies including AWS Services -- State Machines, CDK, Glue, TypeScript, CloudWatch, Lambda, CloudFormation, S3, Glacier Archival Storage, DataSync, Lake Formation, AppFlow, RDS PostgreSQL, Aurora, Athena, and Amazon MSK
  • Experience with Apache Iceberg, Spark, and Python

Education/Certifications:

  • Bachelor's degree in computer science, information technology, or other job-related degree

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.