Data Engineer

Writing, API, SQL, Analytics, Production, Hadoop, Airflow, Java, Python, JavaScript, NoSQL, RDBMS, Amazon Web Services, JSON, Oracle, PostgreSQL, NiFi
Full Time
Depends on Experience

Job Description

We are seeking a highly qualified Data Engineer who will ensure optimal data solutions for our client. 
 
Responsibilities:
  • Design and develop data applications using selected tools and frameworks as required and requested.
  • Read, extract, transform, stage and load data to selected tools and frameworks as required and requested.
  • Perform tasks such as writing scripts, web scraping, calling APIs, write SQL queries, etc.
  • Work closely with the engineering team to integrate your work into our production systems.
  • Process unstructured data into a form suitable for analysis.
  • Analyze processed data.
  • Maintaining data pipeline.
Skills/Requirements
  • 5+ years experience in related field including experience with transformational efforts
  • In-depth knowledge of Hadoop, Airflow, and similar frameworks
  • Knowledge of scripting languages including Java, Python, JavaScript
  • Advanced proficiency with NoSQL and RDBMS databases, AWS Cloud Services
  • Previous experience with Hadoop Stack, Kafka, Airflow, NiFi, SQL Server, PostgreSQL, Oracle, JSON, Parquet, Avro and other Data Storage formats, Tableau, visualization tools, Apache Atlas, and other Data-centric Apache Packages
  • Experience working with orchestration tools
  • Production and analytics data
Dice Id : 90922750
Position Id : 8598
Originally Posted : 2 months ago
Have a Job? Post it