Data Engineer/Software Engineer

Overview

Full Time
Accepts corp to corp applications
Contract - W2
Contract - Independent
Contract - Long Term

Skills

Python
SQL
spark
ETL
Devops
Scala
PYSpark
Databricks
Databricks SQL

Job Details

Job Title: Data Engineer/Software Engineer

Duration: 6 Months Contract with possible extension

Location: Remote

Job Description

  • Work alongside the Technical Lead (TL) to understand ongoing migration and transformation projects.
  • Provide hands-on support and troubleshooting as needed.
  • Assist in documentation of migration processes and best practices.
  • Assist in transitioning legacy release pipelines to new rpcfg configurations.
  • Support JDK migration efforts, ensuring smooth transitions with minimal downtime.
  • Conduct testing and validation to confirm successful migrations
  • Work with cross-functional teams, including Data Engineering, DevOps, and Software Development teams.
  • Provide weekly status updates, knowledge-sharing sessions and document findings to enhance team capabilities

Scope of Work:

  • Develop and enhance Al/BI dashboards using Databricks.
  • Design and implement data visualization solutions to support business intelligence reporting.
  • Perform basic data engineering tasks, including creating, updating, and maintaining data pipelines.
  • Optimize existing ETL processes for efficiency and scalability.
  • Collaborate with internal teams to ensure data accuracy and integrity.
  • Provide documentation and knowledge transfer sessions for developed solutions.
  • Provide weekly status updates, create clear SOP's, and documentation for implemented dashboard solutions.

Qualifications:

  • Expertise in developing Al/BI dashboards using Databricks.
  • Experience with SQL, Python, and Spark for data engineering tasks.
  • Knowledge of data pipeline creation and maintenance.
  • Ability to work independently and collaborate with cross-functional teams.
  • Strong analytical and problem-solving skills.
  • Project management tools like Jira, Confluence, slack

Keywords: Al/BI dashboards, SQL, Python, Spark, Scala, Databricks, ETL, DevOps, Pyspark, Databricks SQL

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About VDart, Inc.