Apply Now

Spark / Databricks Platform Engineer

Austin, TX, US • Posted 8 hours ago • Updated 8 hours ago

Contract Independent

Contract Corp To Corp

Contract W2

12 Months

No Travel Required

On-site

Depends on Experience

Resourcesoft, Inc.

Fitment

Dice Job Match Score™

🔗 Matching skills to job...

Job Details

Skills

Databricks
Apache Spark
PySpark
Delta Lake
DLT
Delta Live Tables
Lakeflow
Medallion Architecture
SQL
Python
Scala
Data Warehousing
Data Modeling
Airflow
Databricks SQL
Data Governance
ETL
CI/CD
Git

Summary

Requirements

8 or more years of experience in designing, developing, and deploying enterprise technology solutions.
Proficiency in PySpark, Scala, and SQL for large-scale data processing on Databricks.
Experience with building and optimizing ETL/ELT pipelines using Apache Spark and Delta Live Tables (DLT).
Experience in Delta Lake architectures, medallion designs (bronze/silver/gold), and lakehouse data modeling.
Experience with creating offline workflows and scheduling orchestration tasks using Lakeflow or Airflow.
Experience in native Databricks dashboard creation, data governance, and data security standards.
Excellent verbal and written communication skills.

Responsibilities

Design, develop, and optimize scalable data lakehouse solutions natively on the Databricks platform.
Build robust ETL/ELT ingestion pipelines utilizing PySpark, Delta Live Tables (DLT), and Spark engines.
Implement medallion architecture frameworks to structure and clean incoming enterprise datasets.
Formulate dimensional data models, star schemas, and gold-layer database structures for business intelligence.
Schedule and orchestrate offline data processing pipelines using Lakeflow Jobs or Airflow frameworks.
Create dynamic data visualizations and custom applications utilizing Databricks SQL dashboards and Databricks Apps.
Audit data quality, implement governance guardrails, and execute workload performance tuning to optimize cost.

Founded in 1999, Resourcesoft, Inc. is a leading Technology Consulting and Professional Services organization. Headquartered in Marlborough, MA, the company serves the technology needs of its clients nationwide. Resourcesoft has often been recognized by prominent rating agencies for its exemplary growth and stability. With over two decades of industry experience, the Company has evolved as a front runner in enabling project optimization. We partner with leading organizations to provide technology solutions within the financial, insurance, education, government, publishing, healthcare and pharmaceutical domains. We take pride in mentoring a workforce that is well positioned to respond to the emerging IT trends and needs. With the employees at the crux of every business endeavor, our success is driven by our expertise in pairing the right talent with the best jobs in the technology sector. We forge long term, personalized relationships with our employees to advance their career to the next level. We engage them in technology centric client projects that provide opportunities for them to evolve, innovate and deliver world class products and services. Our career opportunities offer challenging assignments and exposure to emerging and cutting edge technologies. We are committed to providing our employees with the tools necessary to accelerate their career progression, while maintaining a healthy, work-life balance. We are deeply committed to providing a workplace ambience that is both challenging and fulfilling.

Resourcesoft is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.

For more information about Resourcesoft and our services, please visit our website.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10117734
Position Id: 21823-27990-1785154632
Posted 8 hours ago

Company Info

About Resourcesoft, Inc.

Founded in 1999, Resourcesoft, Inc. is a leading Technology Consulting and Professional Services organization. Headquartered in Marlborough, MA, the company serves the technology needs of its clients nationwide. Resourcesoft has often been recognized by prominent rating agencies for its exemplary growth and stability. With over two decades of industry experience, the company has evolved as a front runner in enabling project optimization. We partner with leading organizations to provide technology solutions within the financial, insurance, education, government, publishing, healthcare and pharmaceutical domains. We take pride in mentoring a workforce that is well positioned to respond to the emerging IT trends and needs. With the employees at the crux of every business endeavor, our success is driven by our expertise in pairing the right talent with the best jobs in the technology sector. We forge long term, personalized relationships with our employees to advance their career to the next level. We engage them in technology centric client projects that provide opportunities for them to evolve, innovate and deliver world class products and services. Our career opportunities offer challenging assignments and exposure to emerging and cutting edge technologies. We are committed to providing our employees with the tools necessary to accelerate their career progression, while maintaining a healthy, work-life balance. We are deeply committed to providing a workplace ambience that is both challenging and fulfilling.

Go to company profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Financial Data Platform Architect

Alexandria, Virginia

•

Today

Requirements 10 or more years of experience in enterprise data engineering and cloud database architecture. Proficiency in Snowflake data platform design, dbt semantic layers, and dimensional data modeling. Experience with corporate accounting systems, financial operations, and asset management processes. Experience in migrating legacy Microsoft BI packages, including SSIS, SSRS, and SSAS, to modern cloud stacks. Experience with cloud ingestion, automation, and transformation tooling including F

Easy Apply

Third Party, Contract

Depends on Experience

Search all similar jobs

More jobs at Resourcesoft, Inc. in Austin, TX