Sr Data Engineer (Remote)

  • Posted 55 days ago | Updated 4 hours ago

Overview

Remote
Depends on Experience
Full Time
No Travel Required

Skills

Amazon EC2
Amazon Web Services
Data Visualization
Extract
Transform
Load
JIRA
PostgreSQL
Python
PySpark

Job Details

Basic Qualifications:
Bachelor s degree from an accredited college in a related discipline, or equivalent experience/combined education, with 8 years of professional experience, or 6 years of professional experience with a related master s degree.
Experience working in software development lifecycle tools, with strong experience in ETL based development.
Design, build, maintain and support ETL/ELT data pipelines using AWS Services and primarily on Glue studio, EC2, S3, DMS, DMS, DMS, CloudFormation, Step Functions, Lambda, Athena, DynamoDB, QuickSight, Event Bridge, SNS, VPC, CloudWatch and CloudTrail.
Design and maintain data ingestion libraries written using PySpark/Python
Experience working with relational databases like PostgreSQL, RDS, Big Data and Oracle
Experience with using version control systems (Git Hub, CodeCommit, Bit Bucket)
Experience with automation tools and scripting to streamline workflows
Experience with using issue/problem tracking systems (Jira preferred)

Preferred Qualifications:
Knowledge or experience with Software Engineering (IEEE) Capability Maturity Model (CMM) standards.
Knowledge or experience with Full Development Lifecycle (FDLC) methodologies.
Familiarity with SQL tools and knowledge of object-oriented programming analysis methods.
Experience with data warehouse, data visualization, statistical techniques and predictive modeling.
Experience with Agile methodologies and tools to manage iterative development processes.
Ability to define and track key performance indicators to ensure project success and team productivity
Experience with SSRS reports.
Knowledge of Azure cloud platform

Primary Responsibilities:
Oversee daily operations and ensure efficiency of data analytics applications.
Respond to and resolve operational issues and incidents promptly of data analytics applications.
Recognize, diagnose, research, and resolve system and design concerns of data analytics applications.
Document root cause analysis and track incidents to identify recurring problems.
Responsible for development and providing development lifecycle support for any code changes or enhancements.
Ensure appropriate Change Management processes/procedures and documentation are followed.
Perform data audits to ensure data accuracy and improve data quality.
Identify potential risks and challenges by analyzing data trends.
Operate the data pipelines in production including release management and production support.

 

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Global CI