Overview
Accepts corp to corp applications
Contract - 4 day((s))
Skills
Data Integration
data engineer
azure fabric
pyspark
Job Details
Hi,
Hope you are doing good !!!
Senior Data Engineer with LLM
Location: Remote USA
Job Description
Support real-time streaming and batch data processing use cases
-
- Ensure data security, privacy, and compliance with enterprise standards Architect, build, and maintain large-scale data ingestion and transformation pipelines
- Develop and optimize ETL/ELT workflows to ensure reliable and high-performance data processing
- Design and manage data storage systems using cloud-based architectures (Azure preferred)
- Implement data governance, data quality frameworks, and monitoring solutions
- Collaborate with stakeholders to understand business requirements and translate them into scalable data solutions
- Develop reusable data engineering components, tools, and processes
Qualifications:
-
- Bachelor's or higher degree in engineering, computer science, or equivalent field
- 7+ years data pipelines and platform development experience
- Experience of Azure technologies (Azure Data Factory, Azure Data Lake, Azure Synapse, etc) are required.
- Experience with Azure SQL, Kusto, Azure storage accounts
- Proficiency with Python is required, and with C# is highly desired
- Understand data security best practice, and able to establish development process to achieve data security.
- Ability to drive technical investigations, 3rd party solution evaluation, and prototyping in a fast-paced startup-like environment.
- Strong sense of curiosity and a willingness to learn, share, and improve.
- Team player with excellent cross-group collaboration skills
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.