Python Data Engineer

company banner
The Judge Group, Inc.
Apache, Architecture, Data Warehouse, Hadoop, HTTP, Python, Research, Shell Scripting, SQL, Testing
Full Time
Work from home not available Travel not required

Job Description


Location: Philadelphia, PA
Salary: $80,000 - $120,000
Description: Our growing client in Philadelphia is currently seeking a Python/Data Engineer
Location: Philadelphia, PA (Center City)

Duration: Direct hire/perm




Please send resumes directly to Melody Georgiou at mgeorgiou@judge.com for immediate consideration.



HOW YOU WILL HELP:


  • You will support the Engineering Team's data endeavors, diving in to fix issues, optimize processes, and automate what you do more than once.
  • You'll use the best tools for the job, whether modern and revolutionary or time test and proven, to deliver elegant, scalable solutions that meet business and technical needs.



WHAT YOU WILL DO:


    • Work with internal stakeholders to load data into data warehouse.
    • Troubleshoot and resolve issues relating to data integrity.
    • Help establish procedures and best practices for transforming and storing data.
    • Lead requirements gathering around data pipeline automation improvements.
    • Work with some of the most exciting open-source tools like Spark, Hadoop, Docker, Airflow, Zeppelin.
    • Leverage distributed computing and server-less architecture such as AWS EMR and AWS Lambda, to develop pipelines for transforming data.
    • Research and implement new technologies with a team of developers to execute strategies and implement solutions.

    REQUIRED SKILLS AND EXPERIENCE:


    • 5+ years of work experience
    • 3+ years of experience with Python
    • 3+ years experience with PySpark and Spark-SQL (writing, testing, debugging Spark routines)
    • 1+ year of experience with AWS EMR, AWS S3 service. Comfortable using AWS CLI and boto3
    • Comfortable working in remote environments
    • Comfortable using *nix command line (Shell scripting, AWK, SED)



    DESIRED EXPERIENCE


    • Experience with Apache Airflow
    • Experience with Apache Zeppelin
    • Experience with Healthcare data



    Contact: mgeorgiou@judge.com

    This job and many more are available through The Judge Group. Find us on the web at www.judge.com



    Company Information

    The Judge Group is a privately-owned, leading professional services firm. What does that mean? It means we provide technology, talent and learning solutions to businesses around the globe, and we're great at it. Our expertise is positioned at the crossroads of people and technology—two of the most important aspects of successful business today.
    Dice Id : cxjudgpa
    Position Id : 604248

    Similar Positions at The Judge Group, Inc.

    Cloud Data Engineer
    • King Of Prussia, PA
    • 2 days ago
    Data Warehouse Engineer
    • Blue Bell, PA
    • 2 days ago
    Big Data Developer
    • Philadelphia, PA
    • 2 days ago
    Data Warehouse Engineer
    • Philadelphia, PA
    • 2 days ago
    Big Data Engineer
    • Wilmington, DE
    • 2 days ago
    Sr. Hadoop Developer
    • Philadelphia, PA
    • 2 days ago
    Python Developer
    • New York City, NY
    • 2 days ago
    Business Analyst
    • Philadelphia, PA
    • 2 days ago
    Technical Business Analyst
    • Philadelphia, PA
    • 2 days ago