Big Data Engineer
Contract Independent
Contract W2
6 Months
No Travel Required
Remote
Depends on Experience
Tek Analytics, LLC
Fitment
Dice Job Match Score™
👾 Reticulating splines...
Job Details
Skills
- Databricks
- Innovation
- Leadership
- Management
- Mentorship
- Google Cloud
- Google Cloud Platform
- IT Strategy
- Decision-making
- Engineering Design
- Good Clinical Practice
- Continuous Improvement
- Data Modeling
- Data Processing
- Collaboration
- Continuous Delivery
- Data Engineering
- Big Data
- Change Data Capture
- Cloud Computing
- Apache HTTP Server
- Apache Kafka
- Apache Spark
- Real-time
- Replication
- SQL
- Scala
- Scalability
- Orchestration
- Performance Tuning
- PySpark
- Python
- Amazon Web Services
- Microsoft Azure
- Migration
- Streaming
- Web Services
- Microsoft
Summary
Job Title: Lead Big Data Engineer
Location: Remote
Employment Type: Contract
Experience Level: Senior / Lead
Primary Technologies: Kafka, Confluent, Databricks, Spark, Delta Lake, Python, SQL, Cloud Platforms (Azure/AWS/Google Cloud Platform)
Location: Remote
Employment Type: Contract
Experience Level: Senior / Lead
Primary Technologies: Kafka, Confluent, Databricks, Spark, Delta Lake, Python, SQL, Cloud Platforms (Azure/AWS/Google Cloud Platform)
Position Overview
We are seeking a highly skilled Lead Big Data Engineer to join our team and work closely with our client in designing, building, and modernizing enterprise-scale data platforms. The ideal candidate will have deep expertise in streaming architectures, event-driven systems, real-time data processing, and modern cloud-based data platforms.
This role requires a strong technical leader who can drive architecture decisions, mentor engineering teams, and deliver scalable, secure, and high-performance data solutions.
Key Responsibilities
Leadership & Architecture
- Define and drive data platform architecture, engineering standards, and best practices.
- Lead and mentor a team of data engineers, providing technical guidance and support.
- Drive technical decision-making and ensure alignment with business objectives.
- Collaborate with Architects, Product Owners, and cross-functional engineering teams.
Data Platform Engineering
- Design and implement end-to-end data ingestion frameworks.
- Build and optimize real-time and batch data pipelines.
- Develop scalable event-driven architectures using Kafka and related technologies.
- Design and implement Change Data Capture (CDC) solutions for transactional data replication.
- Develop and maintain modern data platforms leveraging Databricks and Lakehouse architectures.
- Support cloud migration and data platform modernization initiatives.
Performance, Reliability & Governance
- Ensure solutions meet requirements for scalability, reliability, security, and governance.
- Implement data modeling and performance optimization strategies.
- Support monitoring, troubleshooting, and continuous improvement of data platforms.
- Enable data-driven decision-making through reliable and accessible data solutions.
Required Qualifications
Experience
- 12+ years of experience in Data Engineering, Big Data Engineering, or Data Platform Engineering.
- Proven experience leading engineering teams and driving large-scale data initiatives.
- Strong experience designing both streaming and batch data processing systems.
Technical Skills
Streaming & Event-Driven Systems
- Strong expertise in streaming data architectures and event-driven systems.
- Hands-on experience with:
- Apache Kafka
- Confluent Platform / Confluent Cloud
- Deep understanding of:
- Kafka Topics and Partitions
- Schema Design
- Schema Registry
- Kafka Connect
- ksqlDB
Data Processing & Lakehouse Platforms
- Strong hands-on experience with:
- Databricks
- Apache Spark (PySpark and/or Scala)
- Delta Lake
- Experience designing and implementing Lakehouse architectures.
Programming & Query Languages
- Advanced proficiency in:
- Python
- SQL
- Scala experience is a plus.
CDC & Data Integration
- Strong understanding of Change Data Capture (CDC) patterns and implementation.
Cloud Platforms
- Experience with one or more major cloud providers:
- Microsoft Azure
- Amazon Web Services (AWS)
- Google Cloud Platform (Google Cloud Platform)
Data Engineering Best Practices
- Data modeling
- Performance tuning and optimization
- Security and governance controls
Preferred Qualifications (Nice to Have)
- Hands-on experience with:
- Debezium
- Kafka Connect ecosystem
- Oracle GoldenGate
- SQL-based CDC tools
- Experience with orchestration tools:
- Apache Airflow
- Databricks Workflows
- Infrastructure as Code (IaC):
- Terraform
- CI/CD pipelines for data platforms.
- Experience with monitoring and observability platforms.
- Exposure to multi-cloud data platform strategies.
What Makes This Opportunity Exciting
- Lead the design and evolution of a modern enterprise data platform.
- Work with cutting-edge technologies including Kafka, Confluent Cloud, Databricks, Spark, and Delta Lake.
- Drive real-time data processing and event-driven architecture initiatives.
- Influence technical strategy and architecture decisions.
- Collaborate with talented teams on large-scale cloud modernization programs.
- Make a direct impact on business outcomes through data-driven innovation.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
- Dice Id: 91081496
- Position Id: 9008869
- Posted 1 day ago
Company Info
Tek Analytics, LLC is a technology consulting and staffing firm specializing in delivering high-quality talent and innovative solutions to support complex business and digital transformation initiatives. We partner with organizations across industries to provide expertise in enterprise applications, data & analytics, cloud technologies, and emerging digital solutions.
Our core strength lies in technology staffing and consulting, where we support clients with highly skilled professionals across platforms such as SAP, Oracle, Salesforce, Data Engineering, Analytics, and custom application development. Tek Analytics follows a client-centric approach, focusing on understanding business requirements and delivering resources that align with both technical needs and organizational culture.
With a strong recruiting presence in the United States and a Global Delivery Center (GDC), Tek Analytics combines local market knowledge with global scalability. This hybrid delivery model enables us to provide cost-effective, flexible, and timely solutions while maintaining quality and compliance standards.
Tek Analytics is committed to operational excellence, transparency, and long-term partnerships. Our experienced team emphasizes continuous improvement, data security, and adherence to industry best practices. By blending technical expertise with responsive service, Tek Analytics helps clients accelerate innovation, optimize operations, and achieve sustainable growth.
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs