Overview
Skills
Job Details
Hi,
This is Viswanath from Saksoft.
I have an exciting opportunity as a Data Engineer with one of our clients. If you are interested in this opportunity, please share your updated Resume to proceed further.
Job Title: Data Engineer
Location: Richmond, VA
Hire Type: Contract
Duration: 6- 12 months
Job Description
Job Summary
We are seeking a highly motivated Data Engineer to design and implement scalable, end-to-end data solutions within our Azure Data Lake and Data Warehouse environments. This role is responsible for engaging in close, cross-functional collaboration with Architecture, Infrastructure, and Business teams as well as management to align with enterprise-scale requirements and evolving organizational data strategies.
Key Responsibilities
- Design, develop, test, document, and maintain moderately complex programs using industry standards and tools.
- Optimize data pipelines and queries for performance, scalability, and cost-efficiency across large-scale datasets and distributed systems. Leverage parallel processing techniques to ensure high-throughput and low-latency data operations in Azure cloud environment.
- Develop test specifications, conduct tests, diagnose faults, and produce system integration reports.
- Apply data validation, cleansing, and monitoring techniques to ensure data accuracy, consistency, and reliability across systems.
- Monitor data workflows, diagnose issues, and implement fixes to ensure uninterrupted data operations.
- Participate in code reviews and collaborate with peers to ensure high-quality deliverables.
- Follow directions from senior team members and contribute to a collaborative team environment.
- Build and maintain clear documentation of data flows, architecture decisions, and operational procedures to support knowledge sharing and onboarding.
- Continuously explore and evaluate new tools, frameworks, and best practices in data engineering and cloud computing.
- Occasionally work evenings or weekends and travel as needed to meet business needs.
Requirements:
- 2+ years of experience coding in Python, SQL, Spark, and Spark SQL
- Proven experience with modern data tools such as Spark, ADFS, Databricks, Azure Data Factory, Redis, and Elastic
- 2+ years of experience with relational databases and SQL development/tuning (MS SQL Server preferred)
- Strong understanding of database concepts including Slowly Changing Dimensions (SCD)
Preferred Skills:
- 2+ years of experience with Azure cloud-based applications
- Experience with Agile methodologies and rapid prototyping
- Familiarity with design thinking and customer-centric design
- Experience with Azure DevOps and serverless tools (Logic Apps, Function Apps)
- Azure or Databricks certifications
Thanks & Regards
Viswanath Dulam Senior Team Lead - Recruitment | |
T: (Direct) E:
Innovation Customer focus Openness Respect Enterprising |