Azure Data Engineer/Lead

Overview

Hybrid
Depends on Experience
Full Time

Skills

Azure
ADF
PySpark
Spark
Python
Data Stage
databricks
data bricks
Data Management
Big data
Solution Architect
Collibra DQ
Tidal
ETL
PII
PSI
Healthcare Payer
Data Warehousing
Anlaystics

Job Details

What Working at Hexaware Offers:

Hexaware is a dynamic and innovative IT organization committed to delivering cutting-edge solutions to our clients worldwide. We pride ourselves on fostering a collaborative and inclusive work environment where every team member is valued and empowered to succeed.

Hexaware provides access to a vast array of tools that enhance, revolutionize, and advance professional profiles. We complete the circle with excellent growth opportunities, chances to collaborate with high-profile customers, opportunities to work alongside brilliant minds, and the perfect work-life balance.

 

Role: Azure Data Engineer/Lead

Location: Philadelphia, PA

Duration: Full-time

Mode of work: Hybrid (2-3 days onsite per week)

 

Description: 

Strategic planning and hands-on engineering of Big Data and cloud environments that support our clients advanced analytics and data science initiatives.

Provide support in defining the scope and sizing of work

Working closely with various enterprise architects Information security teams, Data management team, to ensure the architected solution meets all the needs of a customer, from a functionality perspective and IT solution engineering perspective.

Translate business requirements into technology solutions

Lead and own all aspects of our data solution including artifact creation such as diagrams, playbooks and other technical documents

Mentor and guide Jr. team members to deliver the solutions on-time

Create various architecture blueprints and work with the development team to deliver the vision.

 

Domain/Functional Skills:

 

Technical Skills:

  • Overall 10+ years of experience of experience with Data Management, Big Data, Data Warehousing and Analytics.
  • At least 3 to 4 years of experience in Architecting and Implementing Data Solutions on Azure using Databricks.
  • 3+ years of hands-on experience with ADF, Pyspark
  • More than one year of multi-cloud experience in at least two of the three public Cloud Platforms (Azure, AWS and Google Cloud Platform)
  • One to two years of experience in Collibra DQ and DG is plus.
  • 1-2 years of experience in Tidal is also a good addition.
  • 2-3 years of experience in designing and developing ETL solutions using Data Stage.
  • Hands on working experience with scripting languages such as Python, Pyspark, Spark SQL or Shell Scripting, etc.
  • Extensive hands-on experience in building and optimizing Databricks notebooks, tuning and optimizing ETL/ELT process developed ADF.
  • Experience with implementation of data security, encryption, PII/PSI legislation, identity and access management across sources and environments.
  • Experience with data process Orchestration, end-to-end design and build process of Near-Real Time and Batch Data Pipelines
  • Certification in solution architecture, data engineering and development in Azure is preferred.
  • Certification in Databricks is must.
  • 3-5 years of experience in healthcare Payer domain is preferred.
  • Ability to provide technical leadership and oversight on multiple projects/tracks.
  • Strong client-facing communication and facilitation skills

 

Equal Opportunities Employer:

Hexaware Technologies is an equal opportunity employer. We are dedicated to providing a work environment free from discrimination and harassment. All employment decisions at Hexaware are based on business needs, job requirements, and individual qualifications. We do not discriminate based on race including colour, nationality, ethnic or national origin, religion or belief, sex, age, disability, marital status, sexual orientation, parental status, gender reassignment, or any other status protected by law. We encourage candidates of all backgrounds to apply.

 

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.