Cloud Engineer

Hybrid in Austin, TX, US • Posted 20 hours ago • Updated 20 hours ago
Contract Independent
Contract W2
12 Months
No Travel Required
Hybrid
Depends on Experience
Fitment

Dice Job Match Score™

📋 Comparing job requirements...

Job Details

Skills

  • Spark
  • PySpark
  • Shell scripting
  • Teradata
  • DataBricks
  • AbInitio
  • DevOps
  • Azure
  • AWS
  • Healthcare

Summary

Role : Cloud Engineer
Location : Austin, TX

Job Description
  • 3 days a week from the Austin, TX office
  • Work with business and technical leadership to understand requirements.
  • Design to the requirements and document the designs.
  • Ability to write product-grade performant code for data extraction, transformations and loading using Spark, PySpark.
  • Do data modeling as needed for the requirements.
  • Write performant queries using Teradata SQL, Hive SQL and Spark SQL against Teradata and DataBricks Unity Catalog.
  • Implementing dev-ops pipelines to deploy code artifacts on to the designated platform/servers like AWS or DataBricks.
  • Implement DataBricks job orchestration using DataBricks.
  • Troubleshooting the issues, providing effective solutions and jobs monitoring in the production environment.
  • Participate in sprint planning sessions, refinement/story-grooming sessions, daily scrums, demos and retrospectives.
Qualifications

Required:
  • Strong development experience in Spark, PySpark, Shell scripting, Teradata, and DataBricks.
  • Experience with Ab Initio is required.
  • Strong experience in writing complex and effective SQLs (using Teradata SQL, Hive SQL and Spark SQL) and Stored Procedures.
  • Proficiency in Shell Scripting for automation, system administration, and data processing tasks.
  • Excellent work experience on DataBricks as data warehouse/Data Lake implementations.
  • Experience in Agile and working knowledge on DevOps tools (Git, Jenkins, Artifactory) Unix/Linux Shell scripting (KSH) and basic administration of Unix servers CA7 Enterprise Scheduler AWS (S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, and CloudWatch) Databricks (Delta lake, Notebooks, Pipelines, cluster management, Azure/AWS integration).
  • Hands-on experience working with Teradata, including data modeling, SQL development, performance tuning, and large-scale data management.
  • Experience in Jira and Confluence Exercises considerable creativity, foresight, and judgment in conceiving, planning, and delivering initiatives.
  • Strong experience developing large-scale data processing solutions using Apache Spark and PySpark.
Desired:
  • Health care domain knowledge.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 80122034
  • Position Id: 9044763
  • Posted 20 hours ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Hybrid in Austin, Texas

Today

Easy Apply

Contract

Depends on Experience

Hybrid in Austin, Texas

Today

Easy Apply

Contract, Third Party

Depends on Experience

Austin, Texas

Today

Easy Apply

Contract, Third Party

Hybrid in Austin, Texas

8d ago

Easy Apply

Contract

Depends on Experience

Search all similar jobs