Overview
On Site
Depends on Experience
Contract - Independent
Contract - W2
Contract - 12 Month(s)
Skills
Python
Job Details
Data Engineer
Houston, TX/Spring TX- Onsite
Skills Required: Python, Databricks (SQL/Data Engineering), Apache Spark
Responsibilities:
- Design, develop, and maintain scalable data pipelines using Python, Databricks, and Apache Spark.
- Collaborate with data scientists and analysts to understand data requirements and deliver efficient solutions.
- Implement and optimize ETL processes to ensure data quality and integrity.
- Develop and maintain SQL queries and scripts for data extraction, transformation, and loading.
- Monitor and troubleshoot data workflows to ensure high availability and performance.
- Work with large datasets to perform data cleaning, transformation, and analysis.
- Stay up-to-date with the latest industry trends and technologies to continuously improve our data infrastructure
Required skills -
- Solid skills in Python, SQL
- Working experience in Databricks (SQL/Data Engineering), Apache Spark
- GitHub (Actions)
- RestAPl's
- Experience in Databricks & PowerApps Dataverse integration
- ADX / Kusto
- Working experience with dashboarding (one of PowerBI, Databricks, ADX, Spotfire)
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.