Apply Now

Technical Lead Data Engineer

Hybrid in Dallas, TX, US • Posted 3 hours ago • Updated 2 hours ago

Contract Independent

Contract W2

Contract Corp To Corp

12 Months

No Travel Required

Hybrid

$65/hr

Fitment

Dice Job Match Score™

🫥 Flibbertigibetting...

Job Details

Skills

AWS
Databricks
Python
Spark
Pyspark
Change Data Capture
Data Analysis
Data Mapping
Data Processing
API
SQL
Data Integration
Analytical Skill
Scala

Summary

Job Title: Sr Technical Lead - Data

Location: Dallas, TX(Locals Preferred but ok in US)

Mode: Hybrid(3 day a week onsite)

Note: Client Interview is must.

Mandatory skills: AWS, Databricks, Python, Spark & Pyspark

Key Responsibilities:

Experience: 6 to 10 years Realtime experience on databricks is must.
Collaborate as part of a development team to design and enhance large scale applications developed using Python, Spark & Pyspark .
Realtime experience on databricks is must.
Evaluates and plans software designs, test results and technical manuals using AWS.
Confer with business units and development staff to understand both the business and technical requirements for producing technical solutions.
Create and review technical and user-focused documentation for data solutions (data models, data dictionaries, business glossaries, process and data flows, architecture diagrams, etc.).
Extend and enhance the business Data Lake.
Create or implement solutions for metadata management.
Solve for complex data integrations across multiple systems.
Design and execute strategies for real-time data analysis and decisioning.
Build robust data processing pipelines using AWS Services and integrate with multiple data sources.
Translating client user requirements into data flows, data mapping, etc.
Analyses and determines data integration needs and follows Agile practices.

Required Skills:

At least 4+ years of experience on designing and developing Data Pipelines for Data Ingestion or Transformation using Scala or Python.
At least 4 years of experience with Python, Spark & Pyspark.
At least 3 years of experience working on AWS technologies.
Experience of designing, building, and deploying production-level data pipelines using tools from AWS Glue, Lamda, Kinesis using databases Aurora and Redshift.
Experience with Spark programming (Pyspark or scala).
Hands on experience with AWS components like (EMR, S3, Redshift, Lamdba, API Gateway, Kinesis ) in production environments.
Strong analytical skills and advanced SQL knowledge, indexing, query optimization techniques.
Experience using ETL tools for data ingestion.
Experience with Change Data Capture (CDC) technologies and relational databases such as MS SQL, Oracle and DB.
Ability to translate data needs into detailed functional and technical designs for development, testing and implementation.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91173765
Position Id: 9037260
Posted 3 hours ago

Contact the job poster

Vimal Sangam

Recruiter @ J-RAM IT Consulting Inc.

View Profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Hybrid: Sr. Data Technical Lead

Hybrid in Dallas, Texas

•

Today

Job Title: Sr Technical Lead - Data Note: Client Interview is must. Mandatory skills: AWS, Databricks, Python, Spark & Pyspark Key Responsibilities: Experience: 6 to 10 years Realtime experience on databricks is must.Collaborate as part of a development team to design and enhance large scale applications developed using Python, Spark & Pyspark .Realtime experience on databricks is must.Evaluates and plans software designs, test results and technical manuals using AWS.Confer with business units a

Easy Apply

Contract

Depends on Experience

Databricks Data Engineer

Dallas, Texas

•

Today

Responsibilities: Partner with business stakeholders and Global Product teams to understand data domains, business processes, and analytical requirements.Design, develop, and maintain scalable data pipelines and transformation jobs on the Databricks Lakehouse Platform to generate business metrics, KPIs, and curated datasets.Develop and optimize batch and streaming data pipelines using Databricks, Apache Spark (PySpark/Scala), and Delta Lake technologies.Build and maintain data ingestion framewor

Easy Apply

Contract

Depends on Experience

Azure Data Engineer

Hybrid in Dallas, Texas

•

6d ago

Avanciers are seeking an experienced Azure Data Engineer with expertise in Azure Databricks, PySpark, and SQL to design, build, and optimize scalable data solutions. The ideal candidate will participate throughout the SDLC, collaborating with cross-functional teams to develop, test, deploy, and support enterprise data applications. Key ResponsibilitiesGather and document business and technical requirements.Design, develop, and maintain scalable data pipelines using Azure Databricks and PySpark.W

Easy Apply

Full-time

Depends on Experience

Data Engineer in Richardson, TX 75080 (Hybrid)

Richardson, Texas

•

5d ago

Job Title: Senior Data Engineer Work Location: RichardsonTX75080 (Hybrid) Must Have Skills AWS Glue, Lambda, Redshift, EMR Nice to have skills SQL, Python/Pyspark, DAG Detailed Job Description Architect and implement cloud native data pipelines on AWS. Build serverless compute layers using Lambda, Step Functions, and Airflow. Design data lake storage strategies using S3, Glue, Athena, and Redshift. Integrate real-time data streams via Kinesis and SQS Collaborate with business analysts t

Easy Apply

Contract

$52

Search all similar jobs

More jobs at J-RAM IT Consulting Inc. in Dallas, TX