Search Jobs | Dice.com

Job Details

Skills

AWS
Databricks
Python
Spark
Pyspark
Change Data Capture
Data Analysis
Data Mapping
Data Processing
API
SQL
Data Integration
Analytical Skill
Scala

Summary

Job Title: Sr Technical Lead - Data

Location: Dallas, TX(Locals Preferred but ok in US)

Mode: Hybrid(3 day a week onsite)

Note: Client Interview is must.

Mandatory skills: AWS, Databricks, Python, Spark & Pyspark

Key Responsibilities:

Experience: 6 to 10 years Realtime experience on databricks is must.
Collaborate as part of a development team to design and enhance large scale applications developed using Python, Spark & Pyspark .
Realtime experience on databricks is must.
Evaluates and plans software designs, test results and technical manuals using AWS.
Confer with business units and development staff to understand both the business and technical requirements for producing technical solutions.
Create and review technical and user-focused documentation for data solutions (data models, data dictionaries, business glossaries, process and data flows, architecture diagrams, etc.).
Extend and enhance the business Data Lake.
Create or implement solutions for metadata management.
Solve for complex data integrations across multiple systems.
Design and execute strategies for real-time data analysis and decisioning.
Build robust data processing pipelines using AWS Services and integrate with multiple data sources.
Translating client user requirements into data flows, data mapping, etc.
Analyses and determines data integration needs and follows Agile practices.

Required Skills:

At least 4+ years of experience on designing and developing Data Pipelines for Data Ingestion or Transformation using Scala or Python.
At least 4 years of experience with Python, Spark & Pyspark.
At least 3 years of experience working on AWS technologies.
Experience of designing, building, and deploying production-level data pipelines using tools from AWS Glue, Lamda, Kinesis using databases Aurora and Redshift.
Experience with Spark programming (Pyspark or scala).
Hands on experience with AWS components like (EMR, S3, Redshift, Lamdba, API Gateway, Kinesis ) in production environments.
Strong analytical skills and advanced SQL knowledge, indexing, query optimization techniques.
Experience using ETL tools for data ingestion.
Experience with Change Data Capture (CDC) technologies and relational databases such as MS SQL, Oracle and DB.
Ability to translate data needs into detailed functional and technical designs for development, testing and implementation.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91173765
Position Id: 9037260
Posted 4 hours ago

Fitment

Dice Job Match Score™

👤 Reviewing your profile...

Contact the job poster

Vimal Sangam

Recruiter @ J-RAM IT Consulting Inc.

View Profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Hybrid: Sr. Data Technical Lead

Hybrid in Dallas, Texas

•

Today

Job Title: Sr Technical Lead - Data Note: Client Interview is must. Mandatory skills: AWS, Databricks, Python, Spark & Pyspark Key Responsibilities: Experience: 6 to 10 years Realtime experience on databricks is must.Collaborate as part of a development team to design and enhance large scale applications developed using Python, Spark & Pyspark .Realtime experience on databricks is must.Evaluates and plans software designs, test results and technical manuals using AWS.Confer with business units a

Easy Apply

Contract

Depends on Experience

Databricks Data Engineer

Dallas, Texas

•

Today

Responsibilities: Partner with business stakeholders and Global Product teams to understand data domains, business processes, and analytical requirements.Design, develop, and maintain scalable data pipelines and transformation jobs on the Databricks Lakehouse Platform to generate business metrics, KPIs, and curated datasets.Develop and optimize batch and streaming data pipelines using Databricks, Apache Spark (PySpark/Scala), and Delta Lake technologies.Build and maintain data ingestion framewor

Easy Apply

Contract

Depends on Experience

Azure Data Engineer

Hybrid in Dallas, Texas

•

6d ago

Avanciers are seeking an experienced Azure Data Engineer with expertise in Azure Databricks, PySpark, and SQL to design, build, and optimize scalable data solutions. The ideal candidate will participate throughout the SDLC, collaborating with cross-functional teams to develop, test, deploy, and support enterprise data applications. Key ResponsibilitiesGather and document business and technical requirements.Design, develop, and maintain scalable data pipelines using Azure Databricks and PySpark.W

Easy Apply

Full-time

Depends on Experience

MDM Data Engineer

Grand Prairie, Texas

•

Today

Master Data Management (MDM) Data Engineer 100% Remote - EST Hours 6 month CDW Contract CDW is looking for an experienced Master Data Management (MDM) Data Engineer to design and build scalable, cloud-native data solutions on AWS. In this role, you'll develop data pipelines, APIs, and data models that power analytics, reporting, and operational systems while ensuring data quality, governance, and security. Responsibilities Design, build, and optimize cloud-native data pipelines and architecture

Contract

Depends on Experience

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization

Technical Lead Data Engineer

Skills

Summary

Dice Job Match Score™

Vimal Sangam

Similar Jobs

Technical Lead Data Engineer

Job Details

Skills

Summary

Dice Job Match Score™

Vimal Sangam

Similar Jobs