Overview
On Site
Full Time
Skills
Analytics
Analytical Skill
Data Quality
Agile
Sprint
SAN
Teamwork
Process Improvement
Presentations
Data Engineering
Apache Spark
PySpark
SQL
Extract
Transform
Load
ELT
Workflow
Cloud Storage
Data Architecture
Git
Version Control
Continuous Integration
Continuous Delivery
Problem Solving
Conflict Resolution
Communication
Customer Facing
Computer Science
Information Systems
Informatica
Data Management
Data Integration
Databricks
Cloud Computing
Microsoft Azure
Amazon Web Services
Data Governance
Unity
Real-time
Streaming
Apache Kafka
SAP BASIS
Law
IT Service Management
Innovation
Collaboration
Recruiting
Insurance
Finance
Professional Development
Training
Leadership
CompTIA
Customer Service
Career Counseling
Apex
Oracle Application Express
Job Details
Job#: 2075140
Job Description:
Senior Consultant - Databricks Engineer
Overview:
Apex Systems is seeking a Senior Consultant - Databricks Engineer to support the development of scalable, cloud-based data pipelines for enterprise analytics platforms. This role focuses on building robust ETL/ELT workflows using Databricks and Spark, with opportunities to work with advanced features such as Delta Live Tables (DLT) and cloud-native tools like Informatica Intelligent Data Management Cloud (IDMC). The ideal candidate will have hands-on experience building data pipelines from the ground up and strong proficiency in PySpark and SQL.
Key Responsibilities:
Demonstrate strong technical knowledge and implementation skills. Stay current on relevant technology trends and practices.
Build trust and respect among internal and external stakeholders and demonstrate collaborative teamwork.
Produce high quality deliverables, meet project deadlines, and take responsibility for engagement success.
Demonstrate a passion for quality and process improvement.
Demonstrate professional level consulting skills and communication/presentation skills.
Continually innovate, seek creative solutions, and find new ways of adding value. Listen and seek to understand the client and meet their needs, providing consultative guidance.
Stay attuned to the future needs of the client and work with internal resources to identify opportunities. Proactively provide solutions and approach adversity with a solution-focused mindset
Required Skills & Experience:
Preferred Qualifications:
EEO Employer
Apex Systems is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at or .
Apex Systems is a world-class IT services company that serves thousands of clients across the globe. When you join Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRated's Best of Staffing in Talent Satisfaction in the United States and Great Place to Work in the United Kingdom and Mexico.
Apex Benefits Overview: Apex offers a range of supplemental benefits, including medical, dental, vision, life, disability, and other insurance plans that offer an optional layer of financial protection. We offer an ESPP (employee stock purchase program) and a 401K program which allows you to contribute typically within 30 days of starting, with a company match after 12 months of tenure. Apex also offers a HSA (Health Savings Account on the HDHP plan), a SupportLinc Employee Assistance Program (EAP) with up to 8 free counseling sessions, a corporate discount savings program and other discounts. In terms of professional development, Apex hosts an on-demand training program, provides access to certification prep and a library of technical and leadership courses/books/seminars once you have 6+ months of tenure, and certification discounts and other perks to associations that include CompTIA and IIBA. Apex has a dedicated customer service team for our Consultants that can address questions around benefits and other resources, as well as a certified Career Coach. You can access a full list of our benefits, programs, support teams and resources within our 'Welcome Packet' as well, which an Apex team member can provide.
Job Description:
Senior Consultant - Databricks Engineer
Overview:
Apex Systems is seeking a Senior Consultant - Databricks Engineer to support the development of scalable, cloud-based data pipelines for enterprise analytics platforms. This role focuses on building robust ETL/ELT workflows using Databricks and Spark, with opportunities to work with advanced features such as Delta Live Tables (DLT) and cloud-native tools like Informatica Intelligent Data Management Cloud (IDMC). The ideal candidate will have hands-on experience building data pipelines from the ground up and strong proficiency in PySpark and SQL.
Key Responsibilities:
- Design and develop scalable batch and streaming data pipelines in Databricks using PySpark, SQL, and Delta Lake.
- Build ETL/ELT processes that transform and integrate data from diverse sources into unified analytical datasets.
- Leverage Delta Live Tables (DLT) and Databricks Workflows to automate and orchestrate data pipelines (preferred).
- Optimize data pipelines for performance, cost-efficiency, and reusability, applying best practices in Spark tuning and partitioning strategies.
- Collaborate with architects, data modelers, and analysts to understand data requirements and implement business logic in pipelines.
- Implement data quality, monitoring, and observability practices across pipelines.
- Work within Agile delivery teams and participate in sprint planning, code reviews, and deployments.
- Collaborate with cloud platform teams to ensure proper setup of storage, networking, and security.
Demonstrate strong technical knowledge and implementation skills. Stay current on relevant technology trends and practices.
Build trust and respect among internal and external stakeholders and demonstrate collaborative teamwork.
Produce high quality deliverables, meet project deadlines, and take responsibility for engagement success.
Demonstrate a passion for quality and process improvement.
Demonstrate professional level consulting skills and communication/presentation skills.
Continually innovate, seek creative solutions, and find new ways of adding value. Listen and seek to understand the client and meet their needs, providing consultative guidance.
Stay attuned to the future needs of the client and work with internal resources to identify opportunities. Proactively provide solutions and approach adversity with a solution-focused mindset
Required Skills & Experience:
- 5+ years of experience in data engineering, including 3+ years of hands-on experience with Databricks.
- Strong hands-on experience in Apache Spark and/or Delta Live Tables (DLT) for pipeline development.
- Strong proficiency in PySpark and SQL for building and optimizing large-scale data pipelines.
- Experience designing and implementing ETL/ELT workflows in cloud environments (Azure or AWS).
- Familiarity with Delta Lake, Unity Catalog, and Databricks Jobs/Workflows.
- Experience working with structured and semi-structured data from APIs, cloud storage, and enterprise systems.
- Solid understanding of modern data architecture concepts (i.e. Medallion architecture, lakehouse patterns).
- Familiarity with Git-based version control, CI/CD practices, and infrastructure automation.
- Excellent problem-solving and communication skills in client-facing environments.
- Bachelor's degree in Computer Science, Information Systems, or equivalent experience.
Preferred Qualifications:
- Experience with Delta Live Tables (DLT) for declarative pipeline development.
- Exposure to IDMC (Informatica Intelligent Data Management Cloud) or other data integration platforms.
- Databricks or cloud provider certifications (Azure/AWS).
- Familiarity with data governance tools (Unity Catalog, Purview, Collibra) and practices.
- Experience with REST APIs and real-time/streaming architectures (Kafka, Event Hubs, etc.).
EEO Employer
Apex Systems is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at or .
Apex Systems is a world-class IT services company that serves thousands of clients across the globe. When you join Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRated's Best of Staffing in Talent Satisfaction in the United States and Great Place to Work in the United Kingdom and Mexico.
Apex Benefits Overview: Apex offers a range of supplemental benefits, including medical, dental, vision, life, disability, and other insurance plans that offer an optional layer of financial protection. We offer an ESPP (employee stock purchase program) and a 401K program which allows you to contribute typically within 30 days of starting, with a company match after 12 months of tenure. Apex also offers a HSA (Health Savings Account on the HDHP plan), a SupportLinc Employee Assistance Program (EAP) with up to 8 free counseling sessions, a corporate discount savings program and other discounts. In terms of professional development, Apex hosts an on-demand training program, provides access to certification prep and a library of technical and leadership courses/books/seminars once you have 6+ months of tenure, and certification discounts and other perks to associations that include CompTIA and IIBA. Apex has a dedicated customer service team for our Consultants that can address questions around benefits and other resources, as well as a certified Career Coach. You can access a full list of our benefits, programs, support teams and resources within our 'Welcome Packet' as well, which an Apex team member can provide.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.