J-RAM IT Consulting Inc.
J-RAM IT Consulting Inc.

Databricks Technical Lead

Hybrid in Dallas, TX, US • Posted 4 hours ago • Updated 4 hours ago
Contract W2
Contract Corp To Corp
Contract Independent
2 Years
50% Travel Required
Hybrid
Depends on Experience
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • API
  • Agile
  • Amazon Kinesis
  • Amazon Redshift
  • Apache Spark
  • Amazon S3
  • Amazon Web Services
  • Analytical Skill
  • Business Data
  • Change Data Capture
  • Collaboration
  • Data Analysis
  • Data Flow
  • Database
  • Data Integration
  • Data Mapping
  • Data Processing
  • Databricks
  • Development Testing
  • Documentation
  • Electronic Health Record (EHR)
  • Extract, Transform, Load
  • IT Management
  • Python
  • Meta-data Management
  • Oracle
  • PySpark
  • Query Optimization
  • Real-time
  • Relational Databases
  • SQL
  • Scala
  • Systems Design
  • AWS

Summary

Job Title:     Databricks Technical Lead 
Location:     Dallas, TX (Hybrid – 3 days a Week Onsite) - Need Only Locals
 
Mandatory skills: AWS, Databricks, Python, Spark & Pyspark
 
Key Responsibilities:
Experience: 6 to 10 years Realtime experience on databricks is must.
  • Collaborate as part of a development team to design and enhance large scale applications developed using Python, Spark & Pyspark .
  • Realtime experience on databricks is a must.
  • Evaluates and plans software designs, test results and technical manuals using AWS.
  • Confer with business units and development staff to understand both the business and technical requirements for producing technical solutions.
  • Create and review technical and user-focused documentation for data solutions (data models, data dictionaries, business glossaries, process and data flows, architecture diagrams, etc.).
  • Extend and enhance the business Data Lake.
  • Create or implement solutions for metadata management.
  • Solve for complex data integrations across multiple systems.
  • Design and execute strategies for real-time data analysis and decisioning.
  • Build robust data processing pipelines using AWS Services and integrate with multiple data sources.
  • Translating client user requirements into data flows, data mapping, etc.
  • Analyses and determines data integration needs and follows Agile practices.
Required Skills:
  • At least 4+ years of experience on designing and developing Data Pipelines for Data Ingestion or Transformation using Scala or Python.
  • At least 4 years of experience with Python, Spark, & Pyspark.
  • At least 3 years of experience working on AWS technologies.
  • Experience of designing, building, and deploying production-level data pipelines using tools from AWS Glue, Lamda, Kinesis using databases Aurora and Redshift.
  • Experience with Spark programming (Pyspark or scala).
  • Hands on experience with AWS components like (EMR, S3, Redshift, Lamdba, API Gateway, Kinesis ) in production environments.
  • Strong analytical skills and advanced SQL knowledge, indexing, query optimization techniques.
  • Experience using ETL tools for data ingestion.
  • Experience with Change Data Capture (CDC) technologies and relational databases such as MS SQL, Oracle and DB.
  • Ability to translate data needs into detailed functional and technical designs for development, testing and implementation. 
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91173765
  • Position Id: 9129636
  • Posted 4 hours ago
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.
More jobs at J-RAM IT Consulting Inc. in Dallas, TX