Overview
Remote
Depends on Experience
Contract - W2
Contract - 6 Month(s)
Skills
software development
Azure Data factory
Azure Databricks
NoSQL
NET
MVC
C#
Python
Cosmos DB
ETL
Data processing
OLTP
Job Details
Role: Lead Data Engineer
Location: 100% Remote
Duration: 6 months
Responsibilities
- Executes design sessions to gather requirements, review, approve, and communicate design artifacts with stakeholders
- Designing and managing various data models associated with NoSQL DBs (Azure Cosmos, Redis etc.) and Relational DBs (Azure SQL, PostgreSQL etc.)
- Implement data processing solutions for data migration and day-to-day application data management needs using Azure Data Factory and Azure Databricks
- Leverage AI tools to automate SDLC activities and help improve efficiency of individuals and teams.
- Ensures database features and capabilities are incorporated into data model designs to optimize performance, security, resiliency and scalability
- Perform problem-solving application issues and production errors, including high level critical production issues that require immediate attention. Participate in an on-call support rotation
- Monitor and perform performance tuning on application DB usage and ETL/Data processing jobs
- Delivering and presenting proofs of concept to of key technology components to project stakeholders and internal technology leaders
- Working with other members of the project team to support delivery of additional project components associated with cloud data platform
- Perform other DBE duties as assigned
Qualifications
- Bachelor s and/or Master s degree in Computer Science, Computer Engineering or related field preferred
- 8+ years of overall software development experience required
- 4+ years of overall hands-on experience working with Azure data technologies like Cosmos DB, Azure SQL, Redis, Azure Data factory and Azure Databricks
- Strong knowledge and experience in data modeling and relational/NoSQL database design
- Demonstrated expertise in database performance tuning
- Hands-on development experience with NoSQL DBs (Azure Cosmos DB or similar) and/or event-based streaming (Azure EventHub, etc.) technologies highly desired
- Experience building and scaling distributed, microservices based, highly available systems in cloud env (Azure / AWS)
- Expertise in understanding complex business needs, analyzing, designing, and developing solutions
- Communication and professional skills and the ability to establish relationships across business units
- Experience working in a DevSecOps environment with tools such as Github, Azure Devops, Teamcity, ArgoCD, Azure Data Studio, Datadog, Azure Portal
Pluses:
- Financial technology domain knowledge
- Experience with .NET, MVC, C#, Python
- Microsoft Certified: Azure Cosmos DB Developer Specialty or other cloud certifications
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.