Data Engineer

Overview

On Site
Depends on Experience
Contract - W2
Contract - 8 week(s)

Skills

Databricks

Job Details

Data Engineer

Job at a Glance

  • Title: Data Engineer - Middleware Applications
  • Location: Washington, D.C., Philadelphia (4 days per week on site)
  • Contract: W2 only
  • Pay: $70 /hour + optional medical, dental, vision, 401(k) match

Overview

This role involves maintaining and enhancing Middleware Applications hosted in AWS cloud, with a focus on building and optimizing search pipelines using cutting-edge data tools. The position emphasizes infrastructure improvement, system configuration, and collaboration with cross-functional teams.

Key Responsibilities

  • Code software applications to support internal or external customers, ensuring quality through standardized procedures.
  • Oversee testing processes and develop fixes for identified issues.
  • Monitor and maintain operational readiness of Middleware Applications, including those hosted in AWS cloud.
  • Identify opportunities for system enhancements to improve functionality and simplify administration.
  • Facilitate and develop plans for application changes such as defect fixes, enhancements, and configuration updates.
  • Configure and test system modifications, including reports, security, and workflows.
  • Perform and coordinate configuration changes within production environments.
  • Collaborate with BA/QA team members to create test plans and ensure proper issue resolution, fixing, and testing.
  • Work closely with ML and NLP teams to build efficient models and pipelines using Kubernetes, Databricks, Airflow, PySpark, and AWS infrastructure.
  • Develop and maintain scalable services (SOAP and REST) and build modern REST web services.
  • Ensure high-quality implementation of security, data, and system integration.

Required Skills

  • Bachelor's degree in a related field and at least 8 years of experience.
  • Knowledge of standard concepts, practices, and procedures within software engineering.
  • Proven mentorship ability, capable of guiding team members on coding practices and design principles.
  • Expertise in building highly scalable services (SOAP and REST).
  • Proficiency with the Core Spring Framework and related projects such as Spring JMS, Security, Data, and Integration.
  • Skilled at developing modern REST web services.
  • Experience with HTTP and TCP/IP protocols.
  • Strong scripting skills in Python; experience with Ruby is a plus.
  • Experience consuming APIs and web services.
  • Familiarity with AWS, Kubernetes, Apache Airflow, PySpark, and Terraform.
  • Ability to work independently with limited supervision.
  • Creativity and problem-solving skills necessary to optimize system pipelines and processes.

Preferred Skills

  • Experience with content retrieval, search systems, or related fields.
  • Knowledge of ML concepts is a plus but not a primary focus.
  • Experience building and maintaining data pipelines for model training and deployment.
  • Familiarity with cloud-based infrastructure and container orchestration.
  • Experience working in a collaborative team environment with a focus on infrastructure efficiency.

Call to Action

Candidates who meet these requirements and are eager to contribute to system enhancements are encouraged to apply. Join us to work on innovative projects that improve system performance and scalability.

About CEI

As a trusted technology partner, CEI delivers solutions that help our customers transform their business and achieve meaningful results. From strategy and custom application development through application management - our technology and digital experience services are tailored to meet each unique need of our customers. Our staffing solutions bring specialized skills to complement our customers' workforce and project requirements.

#ZR
#INDGEN

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.