Lead PySpark Developer

  • Owings Mills, MD
  • Posted 2 days ago | Updated 9 hours ago

Overview

On Site
USD 53.00 - 68.00 per hour
Full Time

Skills

Optimization
Unstructured Data
Collaboration
Caching
Data Processing
Continuous Integration
Continuous Delivery
Version Control
Automated Testing
Management
Workflow
Data Security
Regulatory Compliance
Mentorship
Computer Science
Information Technology
Big Data
Distributed Computing
FOCUS
Data Engineering
PySpark
Apache Spark
Python
Cloud Computing
Amazon Web Services
Team Leadership
Extract
Transform
Load
Docker
Kubernetes
Life Insurance
Law
Privacy
Security Clearance
LOS

Job Details

Akkodis is seeking a Lead PySpark Developer for a Contract job with a client in Owings Mills, MD(Hybrid). You will lead the design and optimization of scalable ETL pipelines and mentor junior developers while ensuring performance, governance, and best practices in data engineering.

Rate Range: $53/hour to $68/hour; The rate may be negotiable based on experience, education, geographic location, and other factors.

Lead PySpark Developer job responsibilities include:
  • Lead the design, development, and deployment of scalable big data solutions using PySpark and Apache Spark.
  • Architect and optimize ETL pipelines for processing structured and unstructured data across distributed systems.
  • Collaborate with cross-functional teams, including data engineers, data scientists, and business stakeholders, to gather requirements and deliver robust data solutions.
  • Enhance Spark performance through techniques like partitioning, caching, and tuning for large-scale data processing.
  • Implement best practices in data engineering, including CI/CD pipelines, version control, and automated testing.
  • Work with AWS cloud services and tools like DBT and Astronomer to build and manage cloud-native data workflows.
  • Ensure data security, governance, and compliance across all data engineering processes.
  • Mentor junior developers, conduct code reviews, and promote coding standards and efficiency within the team.


Desired Qualifications:
  • Bachelor's or master's degree in computer science, Data Engineering, Information Technology, or a related field.
  • 10+ years of experience in big data and distributed computing, with a strong focus on PySpark and data engineering.
  • Proven hands-on expertise in PySpark, Apache Spark, Python, and cloud-based data platforms such as AWS.
  • Experience leading teams and implementing scalable ETL pipelines using tools like Airflow, DBT, and containerization technologies like Docker and Kubernetes.


If you are interested in this role, then please click APPLY NOW. For other opportunities available at Akkodis, or any questions, feel free to contact me at gopal.gupta@

Pay Details: $53.00 to $68.00 per hour

Benefit offerings available for our associates include medical, dental, vision, life insurance, short-term disability, additional voluntary benefits, EAP program, commuter benefits and a 401K plan. Our benefit offerings provide employees the flexibility to choose the type of coverage that meets their individual needs. In addition, our associates may be eligible for paid leave including Paid Sick Leave or any other paid leave required by Federal, State, or local law, as well as Holiday pay where applicable.

Equal Opportunity Employer/Veterans/Disabled

To read our Candidate Privacy Information Statement, which explains how we will use your information, please navigate to ;br>
The Company will consider qualified applicants with arrest and conviction records in accordance with federal, state, and local laws and/or security clearance requirements, including, as applicable:
  • The California Fair Chance Act
  • Los Angeles City Fair Chance Ordinance
  • Los Angeles County Fair Chance Ordinance for Employers
  • San Francisco Fair Chance Ordinance
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Akkodis