UniqueHire is a digital transformation IT consulting & services company established in 2014 by recruitment leaders in industry who comes with rich experience in Corporate and consulting. We provide cutting edge IT consulting and Professional Services to varied clients.
Data Tech Lead with Java
Contract W2
Contract Independent
12 Months
No Travel Required
On-site
$60 - $65/hr
UniqueHire Consulting LLC
Fitment
Dice Job Match Score™
🧠 Analyzing your skills...
Job Details
Skills
- Python
- PySpark
- Databricks
- Database
- Data Engineering
- Cloud Computing
- Dashboard
- Microsoft Azure
- Orchestration
- Data Migration
- IT Management
Summary
Data Tech Lead with Java
Alpharetta GA (or) Berkley Hills NJ - Onsite
Duration - 1 Year/40 hrs per week
1. Role Overview
Experienced Data Technical Lead to design, develop, and support scalable cloud-based data platforms and streaming data pipelines.
The ideal candidate should possess strong expertise in Databricks, PySpark, Python, Java-based streaming technologies, GitLab CI/CD pipelines, and cloud migration initiatives.
2. Key Responsibilities
- Design and develop scalable Databricks ETL/ELT pipelines (Lakeflow & LakeBase) using Azure Databricks, PySpark, and Python.
- Implement real-time and batch data ingestion frameworks using Kafka and Java-based streaming solutions.
- Develop and optimize data processing workflows in Azure Databricks.
- Integrate and manage data movement between PostgreSQL, YugabyteDB (Cassandra-based NoSQL), and cloud platforms.
- Build reusable frameworks for data ingestion, transformation, validation, and orchestration.
- Develop SQL-based data transformations, reporting datasets, and performance optimization solutions.
- Design and implement GitLab CI/CD pipelines for automated deployment, testing, and release management of Databricks notebooks, jobs, and data pipelines.
- Support Snowflake on-premises to Azure cloud migration initiatives.
- Ensure coding standards, performance tuning, monitoring, and operational stability of data pipelines.
- Develop Power BI dashboards and reports for business intelligence and analytics reporting.
- Develop API automation and integration solutions for data exchange between enterprise systems.
3. Required Skills.
- Strong experience in Python and PySpark development.
- Hands-on experience with Azure Databricks and databricks SQL.
- Experience in Java-based streaming and ingestion frameworks.
- Strong knowledge of Apache Kafka streaming concepts.
- Experience working with PostgreSQL databases.
- Experience with YugabyteDB or Cassandra-based NoSQL databases.
- Strong SQL development and query optimization skills.
- Hands-on experience with GitLab CI/CD pipeline development and deployment automation.
- Understanding cloud-based data engineering and distributed processing concepts.
- Experience in data migration projects, especially Snowflake on-prem to Azure cloud migration.
- Experience designing enterprise-scale data lake or lakehouse architectures.
- Knowledge of streaming architectures and real-time analytics.
- Familiarity with cloud monitoring and observability tools.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
- Dice Id: 91172939
- Position Id: 9014718
- Posted 5 days ago
Company Info
About UniqueHire Consulting LLC
We are committed to build organizations with professional talents who can help our clients to compete in the global market. We provide solutions for the human resource needs of our clients through long-term client relationships built on experience, insight and teamwork. We have a multifaceted team of consultants who are highly experienced and specialize in the vertical they serve.
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs