Data Engineer

• Posted 1 day ago • Updated 1 day ago
Full Time
On-site
Fitment

Dice Job Match Score™

⭐ Evaluating experience...

Job Details

Skills

  • Agile
  • R
  • Data Analysis
  • Reporting
  • Data Integration
  • Data Processing
  • Workflow
  • Scalability
  • Data Quality
  • Production Support
  • Management
  • Computer Science
  • Data Science
  • Software Engineering
  • Information Systems
  • Python
  • Writing
  • SQL
  • PL/SQL
  • Relational Databases
  • Oracle
  • Scripting
  • Windows PowerShell
  • Web Applications
  • Dash Python
  • Continuous Integration
  • Continuous Delivery
  • Git
  • DevOps
  • Storage
  • Apache Parquet
  • Apache Avro
  • Collaboration
  • Problem Solving
  • Conflict Resolution
  • Debugging
  • Extract
  • Transform
  • Load
  • ELT
  • Apache Spark
  • Apache Kafka
  • Microsoft Azure
  • ADF
  • NoSQL
  • Database
  • MongoDB
  • Cosmos-Db
  • SAS
  • Java
  • Scala
  • .NET

Summary

Benefits Summary
  • Flexible and hybrid work arrangements
  • Paid time off/Paid company holidays
  • Medical plan options/prescription drug plan
  • Dental plan/vision plan options
  • Flexible spending and health savings accounts
  • 401(k) retirement savings plan with a Roth savings option and company matching contributions
  • Educational assistance program


Overview

The Data Engineer will be responsible for designing, building, and optimizing scalable data solutions to support a wide range of business needs. This role requires a strong ability to work both independently and collaboratively in a fast-paced, agile environment. The ideal candidate will engage with cross-functional teams to gather data requirements, propose enhancements to existing data pipelines and structures, and ensure the reliability and efficiency of data processes.

Responsibilities

Develop and maintain scripts and tools using Python, PowerShell, and R
Design, write, and optimize SQL queries for performance and scalability
Help modernize 'legacy' solutions to realign with our current code base and tech stack
Assist in redevelopment, improvement and ongoing maintenance of existing data, analytics, and reporting solutions
Ensure accurate and efficient data integration of diverse data sources and formats
Enhance and support database functions and procedures
Optimize data access and data processing workflows for performance, scalability, and efficiency
Implement data quality checks and validations to ensure the accuracy, consistency, and completeness of data
Identify and resolve performance bottlenecks, investigate and troubleshoot data related issues, and provide solutions to address defects
Seamlessly transition between production support and development tasks based on business needs
Deploy and manage code utilizing engineering best practices in non-prod and prod environments

Qualifications

Bachelors Degree in computer science, data science, software engineering, information systems, or related quantitative field.
Minimum 4 years of experience working as a Python Developer, Solutions Engineer, Data Engineer, or similar roles.

Skills
4+ years of solid continuous experience in Python
3+ years of solid experience writing SQL and PL/SQL code
3+ years of experience working with relational databases (solid understanding of Oracle preferred)
2+ years of experience scripting with PowerShell
Experience programming in R
Experience with web application frameworks including Shiny, Dash, Streamlit
Experience with CI/CD utilizing git/Azure DevOps
Knowledge of alternative storage formats including Parquet/Arrow/Avro
Ability to collaborate within and across teams of different technical knowledge to support delivery of solutions
Expert problem-solving skills, including debugging skills, enabling the determination of sources of issues in unfamiliar code or systems

Pluses, but not required: Any work experience in the following:
ETL / ELT tools: Spark, Kafka, Azure Data Factory (ADF)
NoSQL databases: MongoDB, Cosmos DB, DocumentDB or similar
Languages: SAS, Java, Scala, .Net
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 90922487
  • Position Id: 24287293
  • Posted 1 day ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Raritan, New Jersey

Today

Full-time

USD 132,000.00 - 150,000.00 per year

Berkeley Heights, New Jersey

2d ago

Easy Apply

Full-time

100,000 - 110,000

Berkeley Heights, New Jersey

2d ago

Easy Apply

Full-time

100,000 - 110,000

Morristown, New Jersey

Today

Easy Apply

Full-time

USD 85,000.00 - 105,000.00 per year

Search all similar jobs