Data Engineer

company banner
Fahrenheit IT
Python, SQL, MySQL, Apache
Full Time
Work from home not available Travel not required

Job Description

Id: 166564 Location: Philadelphia, PA Job Type: Direct Hire You will support the engineering team's data endeavors, diving in to fix issues, optimize processes, and automate what you do more than once. You'll use the best tools for the job, whether modern and revolutionary or time tested and proven, to deliver elegant, scalable solutions that meet business and technical needs.

Responsibilities:

Work with internal stakeholders to load data into the data warehouse

Troubleshoot and resolve issues relating to data integrity

Help establish procedures and best practices for transforming and storing data

Lead requirements gathering around data pipeline automation improvements

Work with some of the most exciting open-source tools like Spark, Hadoop, Docker, Airflow, Zeppelin

Leverage distributed computing and serverless architecture such as AWS EMR & AWS Lambda, to develop pipelines for transforming data

Solve complex problems related to the real-time discovery of large data

Required skills and experience

5+ years of work experience

3+ years of experience with Python

3+ years of experience with PySpark and Spark-SQL (writing, testing, debugging spark routines)

1+ years of experience with AWS EMR, AWS S3 service. Comfortable using AWS CLI and boto3

Comfortable working in remote environments

Comfortable using *nix command line (shell scripting, AWK, SED)

Experience with MySQL and Postgres

Desired experience

Experience with Apache Airflow

Experience with Apache Zeppelin

Experience with healthcare data


Company Information

Founded in 1998, Fahrenheit IT specializes in IT consulting and direct hire staffing solutions. The company delivers the highest quality technology professionals and an array of customized IT talent solutions designed to improve productivity and drive results. The Company is deeply integrated in the communities it serves and combines significant local market intelligence with the support and resources of a nationwide company.
Dice Id : 10111360
Position Id : 166564
Originally Posted : 8 months ago

Similar Positions at Fahrenheit IT

Data QA Engineer
  • Philadelphia, PA
  • 19 hours ago
Data Architect
  • Philadelphia, PA
  • 19 hours ago
Data Engineer
  • New York, NY
  • 19 hours ago
Software Engineer
  • Philadelphia, PA
  • 19 hours ago
DevOps Engineer
  • Philadelphia, PA
  • 19 hours ago
Full Stack Software Engineer
  • Philadelphia, PA
  • 19 hours ago
Infrastructure Engineer
  • West Chester, PA
  • 19 hours ago
Software Architect
  • Horsham, PA
  • 19 hours ago
Lead Data Engineer Decision Sciences
  • Atlanta, GA
  • 19 hours ago
Network Data Engineer
  • Castle Rock, CO
  • 19 hours ago