Overview
On Site
Depends on Experience
Contract - W2
Contract - 1 Year(s)
No Travel Required
Skills
Data Engineer
Databricks
Python
SQL
AWS
Job Details
PLEASE NO OPT/CPT/H1B and C2C, This is a W2 Contract without any sponsorship
- 5+ years’ experience in large-scale software development/Big Data technologies
- Programming skills in Java/Scala, Python, Shell scripting, and SQL
- Development skills around Hadoop, Spark, PySpark, Hive
- Expert knowledge and experience in Databricks, Lake House, Structured Streaming, Kafka, Delta Lake, Delta Live table, Delta shareetc.
- Design and implement distributed data processing pipelines using Spark, Hive, Python, Airflow, and other tools and languages prevalent in the Hadoop ecosystem. You will be given the opportunity to own the design and implementation. You will collaborate with Product managers, Data Scientists, Engineering folks to accomplish your tasks.
- Design, Develop, Modernize/Migrate pipelines to Databricks
- Develop applications on Cloud preferably AWS
- Explore and build proof of concepts using open source NOSQL technologies such as HBase, DynamoDB, Cassandra and Distributed Stream Processing frameworks like Apache Spark, Kafka stream.
- Take part in DevOps by building utilities, user defined functions and frameworks to better enable data flow patterns.
- Work with architecture/engineering leads and other teammates to ensure high quality solutions through code reviews, engineering best practices documentation.
- Experience in Business Rule management systems like Drools will also come in handy.
Mindlance is an Equal Opportunity Employer and does not discriminate in employment on the basis of Minority/Gender/Disability/Religion/LGBTQI/Age/Veterans.