Overview
Accepts corp to corp applications
Contract - Independent
Contract - W2
Contract - 10 Month(s)
Skills
Python
SQL
ETL
Job Details
Job Title: Senior Data Engineer
Location: Remote
Duration: 10+ months
Term: Contract
Job Description:
- 8+ years of experience working with data infrastructure, ETL processes, and large-scale datasets.
- Proficient in SQL & Python: Strong knowledge of SQL for querying and manipulating data and experience with Python for scripting and automation.
- PowerShell experience - this is our scripting language of choice.
- Proficiency with parquet and delta formats
- Cloud & Big Data: Hands-on experience with Azure cloud and distributed processing (Spark). Experience in Azure technologies like Azure Data Factory, Azure Databricks using Python, Azure Data Lake Storage, Azure Functions, Azure DevOps for CI/CD and Logic App.
- Should be proficient optimizing code for performance (able to read a DAG, determine where CBO is using most resources)
- Strong understanding of data warehousing concepts and dimensional modeling.
- Strong understanding of software development lifecycle from planning to deployment.
- We follow a standard deployment process (dev, test, prod) that includes peer reviewed code
- Problem Solver & Innovator: Passionate about solving complex data challenges and improving system efficiency.
- Team Player & Communicator: Strong collaboration skills, with the ability to explain technical concepts to non-technical stakeholders.
Key Skills:
Data infrastructure, ETL processes, Azure, SQL, Python, PowerShell
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.