Search Jobs | Dice.com

Job Details

Skills

AWS
Databricks
Python
Spark & Pyspark
Scala
Kinesis
Redshift

Summary

Job Title: Sr Technical Lead - Data

Note: Client Interview is must.

Mandatory skills: AWS, Databricks, Python, Spark & Pyspark

Key Responsibilities:

Experience: 6 to 10 years Realtime experience on databricks is must.
Collaborate as part of a development team to design and enhance large scale applications developed using Python, Spark & Pyspark .
Realtime experience on databricks is must.
Evaluates and plans software designs, test results and technical manuals using AWS.
Confer with business units and development staff to understand both the business and technical requirements for producing technical solutions.
Create and review technical and user-focused documentation for data solutions (data models, data dictionaries, business glossaries, process and data flows, architecture diagrams, etc.).
Extend and enhance the business Data Lake.
Create or implement solutions for metadata management.
Solve for complex data integrations across multiple systems.
Design and execute strategies for real-time data analysis and decisioning.
Build robust data processing pipelines using AWS Services and integrate with multiple data sources.
Translating client user requirements into data flows, data mapping, etc.
Analyses and determines data integration needs and follows Agile practices.

Required Skills:

At least 4+ years of experience on designing and developing Data Pipelines for Data Ingestion or Transformation using Scala or Python.
At least 4 years of experience with Python, Spark & Pyspark.
At least 3 years of experience working on AWS technologies.
Experience of designing, building, and deploying production-level data pipelines using tools from AWS Glue, Lamda, Kinesis using databases Aurora and Redshift.
Experience with Spark programming (Pyspark or scala).
Hands on experience with AWS components like (EMR, S3, Redshift, Lamdba, API Gateway, Kinesis ) in production environments.
Strong analytical skills and advanced SQL knowledge, indexing, query optimization techniques.
Experience using ETL tools for data ingestion.
Experience with Change Data Capture (CDC) technologies and relational databases such as MS SQL, Oracle and DB.
Ability to translate data needs into detailed functional and technical designs for development, testing and implementation.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91173765
Position Id: hybdataecleda
Posted 6 hours ago

Fitment

Dice Job Match Score™

📊 Calculating match score...

Contact the job poster

John Kasukurthi

Recruiter @ J-RAM IT Consulting Inc.

View Profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Technical Lead Data Engineer

Hybrid in Dallas, Texas

•

Today

Job Title: Sr Technical Lead - DataLocation: Dallas, TX(Locals Preferred but ok in US)Mode: Hybrid(3 day a week onsite)Note: Client Interview is must.Mandatory skills: AWS, Databricks, Python, Spark & PysparkKey Responsibilities:Experience: 6 to 10 years Realtime experience on databricks is must.Collaborate as part of a development team to design and enhance large scale applications developed using Python, Spark & Pyspark .Realtime experience on databricks is must.Evaluates and plans software de

Easy Apply

Third Party, Contract

Lead Data engineer

Dallas, Texas

•

Today

Job Title: Sr Technical Lead Location: Dallas, TX Mode: Hybrid(3 day a week onsite) C2C or W2 Note: Client Interview is must. Mandatory skills: AWS, Databricks, Python, Spark & Pyspark Key Responsibilities: Experience: 6 to 10 years Realtime experience on databricks is must. Collaborate as part of a development team to design and enhance large scale applications developed using Python, Spark & Pyspark . Realtime experience on databricks is must. Evaluates and plans software designs, test resu

Easy Apply

Full-time, Part-time, Third Party, Contract

Databricks Data Engineer

Dallas, Texas

•

Today

Responsibilities: Partner with business stakeholders and Global Product teams to understand data domains, business processes, and analytical requirements.Design, develop, and maintain scalable data pipelines and transformation jobs on the Databricks Lakehouse Platform to generate business metrics, KPIs, and curated datasets.Develop and optimize batch and streaming data pipelines using Databricks, Apache Spark (PySpark/Scala), and Delta Lake technologies.Build and maintain data ingestion framewor

Easy Apply

Contract

Depends on Experience

Data Engineer in Richardson, TX 75080 (Hybrid)

Richardson, Texas

•

6d ago

Job Title: Senior Data Engineer Work Location: RichardsonTX75080 (Hybrid) Must Have Skills AWS Glue, Lambda, Redshift, EMR Nice to have skills SQL, Python/Pyspark, DAG Detailed Job Description Architect and implement cloud native data pipelines on AWS. Build serverless compute layers using Lambda, Step Functions, and Airflow. Design data lake storage strategies using S3, Glue, Athena, and Redshift. Integrate real-time data streams via Kinesis and SQS Collaborate with business analysts t

Easy Apply

Contract

$52

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization

Hybrid: Sr. Data Technical Lead

Skills

Summary

Dice Job Match Score™

John Kasukurthi

Similar Jobs

Hybrid: Sr. Data Technical Lead

Job Details

Skills

Summary

Dice Job Match Score™

John Kasukurthi

Similar Jobs