Data Engineer

spark, hadoop, kafka, sql, no sql, java, python, scala
Contract W2, Contract Corp-To-Corp
Work from home not available Travel not required

Job Description

ThirdEye's Direct client is looking for a Data Engineer with 5+ years of experience to join a growing team of analytics experts. The candidate will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up.
We are looking for a candidate with 5+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. They should also have experience using the following software/tools:
  • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
  • Experience with big data tools: Hadoop, Spark, Kafka, etc.
  • Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
  • Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
  • Experience with AWS cloud services: EC2, EMR, RDS, Redshift
  • Experience with stream-processing systems: Storm, Spark-Streaming, etc.
  • Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
  • Experience building and optimizing big data data pipelines, architectures and data sets.
  • Strong analytic skills related to working with unstructured datasets.

Posted By

Sanchari Chatterjee

8th FL Victoria Pk Plot 37/2, Block GN Sector-V Kolkata WEST BENGAL, 700091

Dice Id : RTX15f5bd
Position Id : 6212621
Originally Posted : 1 month ago
Have a Job? Post it