Sr Big Data Engineer/Sr. Data Engineer

Description
Top Skills' Details:
1. 10+ years of experience acting as a Sr Data Engineer / Big Data Engineer with the ability to develop and build data pipelines.
2. 2-3+ years of experience working on the databricks platform and Medallion Architecture performing duties like:
- Autoloading
- Lake Flow Connections
- Clusters, Catalogs, and Work spaces
- Building CI/CD Pipelines
- Data Masking
- Data Streaming
3. 5+ years of experience working on the AWS cloud platform and with AWS technologies. (Azure would also suffice).
4. 5+ years of experience working with Python coding language, PySpark, and PySQL.
5. Ability to work with cross functional teams, business and IT stakeholders.
6. Strong business acumen within the HealthCare domain (Health Insurance, Pharmacy, etc..) with knowledge of HIPPA guidelines, PHI/PII
for Data Masking.
Nice to have:
1. If the candidates do not have HealthCare / PHI experience, then Financial Experience is required so they have experience working with PII information.
Position Summary:
The Senior Big Data Engineer drives the design, development, and operational excellence of our data platform built on Databricks and the Delta Lakehouse Architecture. This role requires deep expertise in scalable ETL/ELT, Spark optimization, and modern data governance using Unity Catalog. The Senior Big Data Engineer serves as a technical leader, establishing best practices for code quality, performance, and automated deployments across all
environments.
Responsibilities:
Design and implement scalable data pipelinesusing Delta Lake and manage enterprise-wide data access, security, and lineageusing Unity Catalog
Optimize large-scale Spark jobs (PySpark/SQL)and cluster configurations (Photon) to meet stringent SLA and cost performancetargets across all workflows.
Build resilient data scheduling via Databricks Workflows (Jobs) and establish automated CI/CD pipelines for reliable code promotion across Dev, Staging, and Prod workspaces.
Migrate data and models from relationaldatabases to Databricks.
Ensure best practices for development usingindustry standard development patterns.
Monitor data pipelines performance.
Partner with Data Management and Full Stackdevelopment engineers to operationalize models with current applications and processes.
Support existing data pipelines to ensurebusiness continuity.
Stay updated with the latest trends andtechnologies in data engineering and cloud computing.
Perform other related duties as assigned.
Requirements:
Bachelor's degree is required.
5+ years of experience in Data Engineering, witha significant focus on data warehousing, ETL/ELT development, and distributedsystems
3+ years of hands-on experience developingenterprise solutions on the Databricks platform.
Expertise in PySpark and high-performance SQL
Deep understanding of Delta Lake architectureand optimal maintenance practices
Experience with cloud platforms (AWS preferred)and integrating Databricks with native cloud services (S3, Secret Manager, IAM)
Solid experience implementing CI/CD forDatabricks notebooks and associated libraries.
Healthcare experience is preferred.
Skills
Python, Data, AWS, databricks, Big Data, SQL, Data warehouse, Azure, ETL, Data architecture
Top Skills Details
Python, Data, AWS, databricks, Big Data
Additional Skills & Qualifications
Skills:
Strong development experience with: Python,Spark, or similar technologies
Excellent verbal, communication, negotiation,and presentation skills
Strong analytical and problem-solving skills
Ability to work autonomously while collaboratingacross teams to deliver timely projects.
Ability to explain complex concepts in simple terms.
Dedicated, hardworking employee who achievesmaximum efficiency and productivity.
Strong knowledge of domain-based design, datamodeling and data structures
Strong knowledge of best practice in datamanagement
Core Competencies:
Communication Skills
Customer Service
Building Relationships
Business Knowledge / Organizational Acumen
Initiative and Drive
Leading Self and Others
Experience Level
Expert Level
Job Type & Location
This is a Permanent position based out of Tampa, FL.
Pay and Benefits
The pay range for this position is $140000.00 - $160000.00/yr.
Benefits can be provided upon request
Workplace Type
This is a fully remote position.
Application Deadline
This position is anticipated to close on Apr 6, 2026.
>About TEKsystems:
We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company.

The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.

About TEKsystems and TEKsystems Global Services

We're a leading provider of business and technology services. We accelerate business transformation for our customers. Our expertise in strategy, design, execution and operations unlocks business value through a range of solutions. We're a team of 80,000 strong, working with over 6,000 customers, including 80% of the Fortune 500 across North America, Europe and Asia, who partner with us for our scale, full-stack capabilities and speed. We're strategic thinkers, hands-on collaborators, helping customers capitalize on change and master the momentum of technology. We're building tomorrow by delivering business outcomes and making positive impacts in our global communities. TEKsystems and TEKsystems Global Services are Allegis Group companies. Learn more at TEKsystems.com.

The company is an equal opportunity employer and will consider all applications without regard to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.