Lead Data Engineer

Overview

Accepts corp to corp applications
Contract - W2

Skills

Data Architecture
PySpark
PL/SQL
Extract
Transform
Load
Data Warehouse
Analytical Skill
Conflict Resolution
Problem Solving
Big Data
Apache Spark
Apache Hive
Cloud Computing
Dimensional Modeling
SQL
Data Analysis
Databricks
Amazon Web Services
Amazon S3
Database Design
Data Mining
Multitasking
Leadership
Effective Communication
Modeling
Management
Requirements Analysis
Software Design
Data-flow Diagrams
Roadmaps
Accountability
Use Cases
Project Planning
Technical Direction
Mentorship
Offshoring

Job Details

16964



Job Title : Lead Data Engineer

Location : Boynton Beach, FL

******** W2&C2C*********



Positions : 3



JD :

10+ years experience with

Digital : Databricks

Digital : PySpark



Must-Have:

Designing and implementing highly performant data ingestion pipelines from distributed systems using Apache Spark and Databricks

Experience in data architecture principles and practices Highly proficient with PySpark, and PLSQL

Hands on experience in building ETL data warehouse transformation processes

Strong experience with Big Data, Data analysis with excellent analytical and problem-solving abilities

Hands on experience in Big Data components such as Spark SQL, Data frames, HIVE etc. implemented using Data Bricks.

Hands on experience on Cloud based environments - AWS preferred.

Hands on experience in building pipelines in Databricks.

Hands on experience in building relational and dimensional data model

Very strong SQL and data analysis skills

Understanding of Databricks-AWS integrations, Delta Lake on AWS S3.Technical expertise regarding data models, database design development, data mining and segmentation techniques.

Excellent technical, diagnostic, and troubleshooting skills.

Strong leadership and organizational abilities.

Ability to multitask and work under pressure.

Good leadership skills.

Highly motivated and willing to learn new technologies.

Keeping up to date with industry trends and developments.

Effective communication and interpersonal skills.

Exposure to Data Vault Modelling.



Responsibility of Expectations from the Role:

1. Oversee the technical team and all projects they undertake.

2. Takes the lead role in requirements analysis and solution design (high level and low level) of a varied portfolio of design initiatives.

3. Assume responsibility for all design artifacts, data flow diagrams and produce the conceptual, logical, and physical data models.

4. Contribute to strategic product roadmap definition and delivery.

5. Determining project requirements and developing work schedules for the team.

6. Engage with key stakeholders throughout the organization to ensure the solutions we are accountable for meet the current and future business demand.

7. Assist Product Owner to define use cases, requirements, and project planning.

8. Providing technical direction, mentoring and best practices to both onshore and offshore Teams.

9. Collaborating with the team to identify and fix technical problems.10Should be able to work with team and inspire them to reach their goals.

11. Communicating with the clients to ascertain their needs.

12. Connect with client team and Business team to gather project requirement.

NOTE: Interested candidates share your resumes to umamaheswari at galaxy itech dot com or reach out me four eight zero four zero seven six nine two eight

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.