Search Jobs | Dice.com

Job Details

Skills

IT Management
Collaboration
Databricks
Documentation
Business Data
Meta-data Management
Real-time
Data Analysis
Data Processing
Data Flow
Data Mapping
Data Integration
Agile
Python
Apache Spark
PySpark
Scala
Amazon Web Services
Electronic Health Record (EHR)
Amazon S3
Amazon Redshift
API
Amazon Kinesis
Analytical Skill
Query Optimization
Extract
Transform
Load
Change Data Capture
Relational Databases
SQL
Oracle
Database
Development Testing

IT Management
Collaboration
Databricks
Documentation
Business Data
Meta-data Management
Real-time
Data Analysis
Data Processing
Data Flow
Data Mapping
Data Integration
Agile
Python
Apache Spark
PySpark
Scala
Amazon Web Services
Electronic Health Record (EHR)
Amazon S3
Amazon Redshift
API
Amazon Kinesis
Analytical Skill
Query Optimization
Extract
Transform
Load
Change Data Capture
Relational Databases
SQL
Oracle
Database
Development Testing

Summary

Job Title: Sr Technical Lead

Location: Dallas, TX

Mode: Hybrid(3 day a week onsite)

C2C or W2

Note: Client Interview is must.

Mandatory skills: AWS, Databricks, Python, Spark & Pyspark

Key Responsibilities:

Experience: 6 to 10 years Realtime experience on databricks is must.
Collaborate as part of a development team to design and enhance large scale applications developed using Python, Spark & Pyspark .
Realtime experience on databricks is must.
Evaluates and plans software designs, test results and technical manuals using AWS.
Confer with business units and development staff to understand both the business and technical requirements for producing technical solutions.
Create and review technical and user-focused documentation for data solutions (data models, data dictionaries, business glossaries, process and data flows, architecture diagrams, etc.).
Extend and enhance the business Data Lake.
Create or implement solutions for metadata management.
Solve for complex data integrations across multiple systems.
Design and execute strategies for real-time data analysis and decisioning.
Build robust data processing pipelines using AWS Services and integrate with multiple data sources.
Translating client user requirements into data flows, data mapping, etc.
Analyses and determines data integration needs and follows Agile practices.

Required Skills:

At least 4+ years of experience on designing and developing Data Pipelines for Data Ingestion or Transformation using Scala or Python.
At least 4 years of experience with Python, Spark & Pyspark.
At least 3 years of experience working on AWS technologies.
Experience of designing, building, and deploying production-level data pipelines using tools from AWS Glue, Lamda, Kinesis using databases Aurora and Redshift.
Experience with Spark programming (Pyspark or scala).
Hands on experience with AWS components like (EMR, S3, Redshift, Lamdba, API Gateway, Kinesis ) in production environments.
Strong analytical skills and advanced SQL knowledge, indexing, query optimization techniques.
Experience using ETL tools for data ingestion.
Experience with Change Data Capture (CDC) technologies and relational databases such as MS SQL, Oracle and DB.
Ability to translate data needs into detailed functional and technical designs for development, testing and implementation.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91112461
Position Id: OOJ - 3438-2439-1785191627
Posted 2 hours ago

Fitment

Dice Job Match Score™

📋 Comparing job requirements...

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Technical Lead Data Engineer

Hybrid in Dallas, Texas

•

Today

Job Title: Sr Technical Lead - DataLocation: Dallas, TX(Locals Preferred but ok in US)Mode: Hybrid(3 day a week onsite)Note: Client Interview is must.Mandatory skills: AWS, Databricks, Python, Spark & PysparkKey Responsibilities:Experience: 6 to 10 years Realtime experience on databricks is must.Collaborate as part of a development team to design and enhance large scale applications developed using Python, Spark & Pyspark .Realtime experience on databricks is must.Evaluates and plans software de

Easy Apply

Third Party, Contract

Hybrid: Sr. Data Technical Lead

Hybrid in Dallas, Texas

•

Today

Job Title: Sr Technical Lead - Data Note: Client Interview is must. Mandatory skills: AWS, Databricks, Python, Spark & Pyspark Key Responsibilities: Experience: 6 to 10 years Realtime experience on databricks is must.Collaborate as part of a development team to design and enhance large scale applications developed using Python, Spark & Pyspark .Realtime experience on databricks is must.Evaluates and plans software designs, test results and technical manuals using AWS.Confer with business units a

Easy Apply

Third Party, Contract

Depends on Experience

Data Engineer in Richardson, TX 75080 (Hybrid)

Richardson, Texas

•

6d ago

Job Title: Senior Data Engineer Work Location: RichardsonTX75080 (Hybrid) Must Have Skills AWS Glue, Lambda, Redshift, EMR Nice to have skills SQL, Python/Pyspark, DAG Detailed Job Description Architect and implement cloud native data pipelines on AWS. Build serverless compute layers using Lambda, Step Functions, and Airflow. Design data lake storage strategies using S3, Glue, Athena, and Redshift. Integrate real-time data streams via Kinesis and SQS Collaborate with business analysts t

Easy Apply

Contract

$52

Azure Data Engineer

Hybrid in Dallas, Texas

•

6d ago

Avanciers are seeking an experienced Azure Data Engineer with expertise in Azure Databricks, PySpark, and SQL to design, build, and optimize scalable data solutions. The ideal candidate will participate throughout the SDLC, collaborating with cross-functional teams to develop, test, deploy, and support enterprise data applications. Key ResponsibilitiesGather and document business and technical requirements.Design, develop, and maintain scalable data pipelines using Azure Databricks and PySpark.W

Easy Apply

Full-time

Depends on Experience

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization

Lead Data engineer

Skills

Summary

Dice Job Match Score™

Similar Jobs

Lead Data engineer

Job Details

Skills

Summary

Dice Job Match Score™

Similar Jobs