Overview
On Site
Hybrid
Contract - W2
Skills
Management
Storage
Data Processing
Workflow
Data Science
Data Quality
Technical Writing
Automated Testing
Scripting
Computer Science
Information Technology
Data Engineering
Software Development
Python
Terraform
Data Architecture
Data Modeling
Data Warehouse
Extract
Transform
Load
Apache Spark
Apache Kafka
Amazon Kinesis
Artificial Intelligence
Machine Learning (ML)
Data Security
Regulatory Compliance
Conflict Resolution
Problem Solving
Communication
Collaboration
Cloud Computing
Amazon Web Services
Microsoft Azure
Agile
Version Control
Git
Data Visualization
Tableau
IBM Cognos Analytics
Analytics
NIST SP 800 Series
Sarbanes-Oxley
Optimization
Real-time
Job Details
Description:Your Mission:
As a Data Engineer, you will be responsible for the development, optimization, and management of data ingestion, transformation, and storage processes using modern frameworks. The successful candidate will implement infrastructure-as-code and automation solutions to streamline and build resiliency into data processing workflows. You will work closely with our data science and analytics teams to create and optimize data and machine learning models that support stakeholder needs.
The responsibilities of this position include, but are not limited to:
Design, build, and maintain large-scale data systems, including data warehouses, data lakes, and data pipelines
Develop and implement data architectures that meet the needs of our business stakeholders
Collaborate with data scientists and analysts to develop and deploy machine learning models and data products
Ensure data quality, security, and compliance with standards
Develop and maintain technical documentation of data systems and architectures
Troubleshoot and resolve data-related issues and optimize system performance
Develop and implement automated testing and deployment scripts to ensure smooth and efficient delivery of data solutions
Collaborate with cross-functional teams to identify and prioritize data requirements and develop solutions to meet business needs
Basic Qualifications:
*** ship is required for this role ***
Bachelor's degree in Computer Science, Information Technology, or related field (or equivalent combination of education and experience)
7+ years of experience in data engineering, software development, or a related field
Strong programming skills in languages such as Python and Terraform
Strong understanding of data architecture, data modeling, and data warehousing concepts
Experience with data pipeline tools such as Apache Spark, Apache Kafka, AWS Kinesis
Experience with Artificial Intelligence and Machine Learning technologies
Strong understanding of data security and compliance principles and practices
Excellent problem-solving skills, with the ability to analyze complex data systems and identify areas for improvement
Strong communication and collaboration skills, with the ability to work effectively with cross-functional teams
Desired Skills:
Experience with cloud-based data platforms such as AWS and Azure
Experience with agile development methodologies and version control systems such as Git
Experience with data visualization tools such as Tableau and Cognos Analytics
Familiarity with complex data regulatory requirements such as NIST 800-171 and SOX
Familiarity with OpenTelemetry standards
Optimization for observability data and real time anomaly detections
As a Data Engineer, you will be responsible for the development, optimization, and management of data ingestion, transformation, and storage processes using modern frameworks. The successful candidate will implement infrastructure-as-code and automation solutions to streamline and build resiliency into data processing workflows. You will work closely with our data science and analytics teams to create and optimize data and machine learning models that support stakeholder needs.
The responsibilities of this position include, but are not limited to:
Design, build, and maintain large-scale data systems, including data warehouses, data lakes, and data pipelines
Develop and implement data architectures that meet the needs of our business stakeholders
Collaborate with data scientists and analysts to develop and deploy machine learning models and data products
Ensure data quality, security, and compliance with standards
Develop and maintain technical documentation of data systems and architectures
Troubleshoot and resolve data-related issues and optimize system performance
Develop and implement automated testing and deployment scripts to ensure smooth and efficient delivery of data solutions
Collaborate with cross-functional teams to identify and prioritize data requirements and develop solutions to meet business needs
Basic Qualifications:
*** ship is required for this role ***
Bachelor's degree in Computer Science, Information Technology, or related field (or equivalent combination of education and experience)
7+ years of experience in data engineering, software development, or a related field
Strong programming skills in languages such as Python and Terraform
Strong understanding of data architecture, data modeling, and data warehousing concepts
Experience with data pipeline tools such as Apache Spark, Apache Kafka, AWS Kinesis
Experience with Artificial Intelligence and Machine Learning technologies
Strong understanding of data security and compliance principles and practices
Excellent problem-solving skills, with the ability to analyze complex data systems and identify areas for improvement
Strong communication and collaboration skills, with the ability to work effectively with cross-functional teams
Desired Skills:
Experience with cloud-based data platforms such as AWS and Azure
Experience with agile development methodologies and version control systems such as Git
Experience with data visualization tools such as Tableau and Cognos Analytics
Familiarity with complex data regulatory requirements such as NIST 800-171 and SOX
Familiarity with OpenTelemetry standards
Optimization for observability data and real time anomaly detections
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.