Data Engineer

Description

We are looking for a skilled Software Developer to design, develop, and maintain middleware applications that drive business functionality and enhance user experiences. This long-term contract position requires expertise in creating scalable, high-performing solutions while collaborating with cross-functional teams to ensure seamless integration and operational readiness. Join our team in Philadelphia, Pennsylvania, to contribute to impactful projects and deliver innovative software solutions.

Job Description

We are seeking a talented Data Engineer to join a cutting-edge team supporting machine learning (ML) research efforts. This role focuses on building and optimizing data pipelines and infrastructure to enable more efficient ML model development and deployment. As a key collaborator with ML and NLP teams, you'll work on infrastructure solutions for faster model building, optimization, and production deployment. If you're a hands-on engineer with strong cloud infrastructure experience, particularly with AWS, and a passion for enabling ML research, we want to hear from you!

Key Responsibilities

• Design, build, and maintain data pipelines and ML infrastructure to support AI/ML research teams.
• Collaborate with ML and NLP scientists to address content retrieval needs and build search-related solutions.
• Create scalable solutions using technologies like Python, Airflow, Databricks, Kubernetes, and AWS.
• Optimize Databricks notebooks using PySpark, structure ML pipelines, and assist with model production workflows.
• Develop and deploy REST APIs for model serving and infrastructure communication.
• Maintain and support Kubernetes clusters for model deployment in production environments.
• Focus on content retrieval and database query solutions, contributing backend querying expertise (Java, Kotlin, Go).

Schedule: 4 days onsite 1 day remote

Requirements

Key Technologies

• Required:
• Python(Microservices and Data Pipelines).
• Kubernetes(Container orchestration and deployment).
• Airflow(Designing and maintaining data pipelines).
• AWS(Cloud infrastructure expertise).
• Preferred( Not Required ):
• Databricks(Workbooks and ML pipeline development).
• PySpark(Notebook optimization).
• Pytorch(For process improvement/distillation).
• Content Retrieval/Database Querying(Java, Kotlin, Go).

What We're Looking For

• Strong background inAWSinfrastructure with the ability to hit the ground running.
• Skills inKubernetes, especially for deploying models in containerized environments.
• Proficiency inAirflowfor robust and scalable data pipeline development.
• Demonstrated expertise inPython, especially for microservices and pipelines.
• Ability to collaborate with ML teams without direct modeling responsibilities (this is ML-adjacent , focused on infrastructure).
• Nice to Have: Experience with content retrieval, backend querying, and ML pipelines.

Disqualifiers

• Candidates heavily focused onmachine learning modelingroles (this position is centered on infrastructure).

Why Join Us?

• Work closely with top-tierAI/ML research teamson cutting-edge initiatives.
• Develop tools and infrastructure that drive innovation in AI and NLP.
• Competitive compensation with benefits (health, vision, dental).

Technology Doesn't Change the World, People Do.

Robert Half is the world's first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.

Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app and get 1-tap apply, notifications of AI-matched jobs, and much more.

All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information.

2025 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking "Apply Now," you're agreeing to Robert Half's Terms of Use.