Role Name : Data Engineer Location: Plano, TX
Rate: $70 - 80/hr on W2
Employment Type: W2 Only
Candidate Requirement: Local candidates only
Client: JPMC
Interview Process: Round 1 Zoom | Round 2 In-Person at JPMC Location
Job Description:
We are seeking an experienced Data Engineer with strong hands-on expertise in PySpark, Java, Spark, and ETL/streaming pipelines. The ideal candidate will have experience developing scalable data processing solutions, building cloud-based applications using AWS services, and applying software engineering best practices throughout the development lifecycle. Familiarity with infrastructure automation and LLM-based solutions is a plus.
Key Responsibilities:
Design, develop, test, deploy, maintain, and improve software applications and data processing solutions using Java or Python.
Build and maintain ETL and streaming pipelines using PySpark, Apache Spark, and related technologies.
Develop scalable data engineering solutions and integrate AWS services such as SQS, Lambda, S3, and RDS.
Apply appropriate software design techniques and engineering best practices to develop reliable, secure, and maintainable applications.
Participate in the complete software development lifecycle, including business analysis, development, testing, deployment, maintenance, and continuous improvement.
Follow Agile methodologies and collaborate with cross-functional teams to deliver quality solutions.
Apply Continuous Integration, Continuous Delivery, Test-Driven Development, cloud development, application resiliency, and security practices.
Contribute to infrastructure automation using Terraform and support Unix-based environments and shell scripting as needed.
Explore and contribute to practical LLM use cases using Azure OpenAI or related technologies, where applicable.
Required Qualifications:
4 5+ years of applied software engineering experience, supported by formal training or relevant certification in software engineering concepts.
Extensive hands-on experience with PySpark, Java, Spark, and ETL/streaming pipelines.
Advanced proficiency in Python or Java.
Experience with AWS services, including SQS, Lambda, S3, and RDS.
Strong understanding of software development methodologies, design techniques, and the software development lifecycle.
Experience with Agile methodologies and at least one common Agile framework.
Understanding of Continuous Integration, Continuous Delivery, Test-Driven Development, cloud development, application resiliency, and security.
Bachelor's degree in Computer Science, Computer Engineering, Mathematics, or a related technical field.
Must be local to Plano, TX, and available for an in-person second-round interview at the JPMC location.
Preferred Qualifications:
Experience with shell scripting and Unix/Linux systems.
Proficiency in Terraform for infrastructure management.
Familiarity with modern Large Language Model (LLM) techniques.
Practical LLM use case development experience using Azure OpenAI.
Mandatory Required Skills:
Data Engineering, PySpark, Apache Spark, Java, Python, ETL Pipelines, Streaming Pipelines, AWS, Amazon SQS, AWS Lambda, Amazon S3, Amazon RDS, Software Engineering, Application Development, Agile, CI/CD, Continuous Integration, Continuous Delivery, Test-Driven Development, Cloud Development, Application Resiliency, Application Security
Preferred Skills: Shell Scripting, Unix, Linux, Terraform, Large Language Models, LLM, Azure OpenAI
