Data Architect (Hybrid Onsite)

Dallas, TX, US • Posted 2 hours ago • Updated 2 hours ago
Contract Corp To Corp
Contract W2
Contract Independent
12 Months
No Travel Required
On-site
Depends on Experience
Company Branding Image
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • AWS EMR
  • Apache Spark
  • Apache Hudi

Summary

Job Title

Data Architect (Hybrid Onsite)

Location

Dallas, TX

Duration

12 Months

Interview Type

Virtual / In-Person

Note

  • Dallas, TX required - Hybrid at client site 4 days/week

Description

Position Overview

We are looking for an experienced Senior Data Engineer contractor to support the onboarding and integration of datasets used by Middle Office functions.

The successful candidate will be responsible for designing, developing, and operationalizing reliable data pipelines that ingest data from multiple sources, transform and model it for downstream consumption, and make it available through scalable data platforms.

This is a hands-on engineering role requiring strong experience with AWS, Apache Spark/PySpark, modern data lake technologies, workflow orchestration, data modeling, and infrastructure-as-code/CI/CD practices.

The ideal candidate should be comfortable taking a dataset from initial requirements and source analysis through to a production-ready, supportable data product or pipeline.

 

Required Technical Skills

 

AWS & Cloud Data Engineering

Strong hands-on experience with AWS data and analytics services, particularly:

• AWS EMR

• AWS Glue and Glue Data Catalog

• Amazon Athena

• Amazon S3

• AWS IAM and general AWS security concepts

 

The candidate should understand how these services work together when designing and operating enterprise-scale data pipelines.

Spark & Big Data

 

Expert-level or strong hands-on experience with:

• Apache Spark

• PySpark

• Distributed data processing

• Large-scale dataset transformation and optimization

• Spark performance tuning and troubleshooting

• Partitioning and efficient data processing strategies

 

Strong experience working with modern data lake/table formats, particularly:

• Apache Hudi

• Apache Iceberg

 

The candidate should understand concepts such as schema evolution, partitioning, incremental processing, upserts, snapshots, and management of large analytical tables.

Python & Software Engineering

 

Strong programming skills in:

• Python

• PySpark

 

Candidate should consistently produce clean, modular, maintainable, and production-quality code, with experience in:

• Object-oriented and modular design where appropriate

• Unit and integration testing

• Error and exception handling

• Logging

• Code reviews

• Git-based development workflows

 

Workflow Orchestration

Strong hands-on experience with Apache Airflow or a comparable enterprise orchestration platform.

 

Candidate should be comfortable designing:

• DAGs and workflow dependencies

• Scheduling

• Retry and failure-handling strategies

• Backfill and rerun processes

• Monitoring and alerting

• Parameterized and reusable workflows

Experience with Amazon MWAA is an asset.

Data Architecture & Modeling

 

Strong understanding of:

• Data modeling

• Data pipeline architecture

• Data lake architecture

• Schema design

• Data partitioning

• Incremental data processing

• Historical data management

• Data quality and reconciliation

• Data lineage

 

Candidate should be capable of translating business requirements into a scalable technical data model and an operationally supportable data pipeline.

Infrastructure & CI/CD

 

Working knowledge of modern DevOps and infrastructure-as-code practices, including:

• Terraform

• GitHub Actions

• Git

• CI/CD pipelines

• Automated testing and deployment

• Environment configuration and promotion

 

The candidate does not need to be a dedicated DevOps engineer but should be comfortable working with infrastructure definitions and deployment pipelines as part of normal data engineering development.

 

Preferred Qualifications

• Previous experience building data platforms or data products within financial services, asset management, capital markets, or investment management.

• Experience supporting Middle Office, investment operations, risk, portfolio management, or trading-related datasets.

• Experience onboarding datasets from external vendors, APIs, files, databases, or enterprise data platforms.

• Understanding of data governance, lineage, entitlement, security, and audit requirements in an enterprise environment.

• Experience designing pipelines that process both historical and incremental/daily datasets.

• Experience troubleshooting and optimizing large-scale Spark workloads.

• Experience operating production data pipelines with defined SLAs and operational support requirements.

 

Candidate Profile

We are looking for someone who is more than a developer executing predefined specifications. The contractor should be able to independently understand a data requirement, analyze the source data, propose an appropriate technical design, implement the solution, and bring the pipeline into production.

 

The successful candidate should demonstrate:

• Strong analytical and problem-solving abilities.

• Ownership and accountability for delivering production-quality solutions.

• Ability to work independently while collaborating effectively across teams.

• Strong communication skills when working with both technical and business stakeholders.

• Attention to data quality, reliability, maintainability, and operational readiness.

• Ability to quickly understand unfamiliar datasets and business requirements.

 

Core Technology Stack

Cloud: AWS

Processing: Apache Spark, PySpark

Data Lake / Table Formats: Apache Hudi, Apache Iceberg

AWS Data Services: EMR, Glue, Athena, S3

Orchestration: Apache Airflow / MWAA

Programming: Python, PySpark

Infrastructure as Code: Terraform

CI/CD: GitHub Actions

Version Control: Git

 

Minimum Experience

  • Approximately 5+ years of professional data engineering or big-data engineering experience.

  • Demonstrated experience developing and supporting production data pipelines.

  • Strong hands-on Spark/PySpark and Python development experience.

  • Hands-on experience with AWS-based data platforms.

  • Demonstrated experience with at least one modern data lake/table technology such as Hudi or Iceberg.

  • Experience with workflow orchestration and CI/CD practices.

  • For this contractor role, preference should be given to candidates who can demonstrate hands-on delivery experience rather than primarily architectural or theoretical knowledge. 

Top Skills & Years of Experience

Key Responsibilities

  • Onboard new datasets required to support Middle Office business processes, analytics, reporting, and downstream applications.

  • Work with business and technology stakeholders to understand data requirements, source systems, data structures, business rules, and downstream consumption patterns.

  • Design scalable data ingestion, transformation, and processing solutions using AWS and Apache Spark/PySpark.

  • Develop and maintain production-grade data pipelines using services such as AWS EMR, AWS Glue, Amazon S3, and Amazon Athena.

  • Design and work with large-scale data lake tables using technologies such as Apache Hudi and Apache Iceberg.

  • Build workflow orchestration and scheduling solutions using Apache Airflow or equivalent orchestration technologies.

  • Perform data modeling and design appropriate schemas, partitioning strategies, data structures, and transformation layers for analytical and operational use cases.

  • Build pipelines with appropriate operational capabilities, including monitoring, logging, alerting, data-quality validation, failure handling, retries, and recovery mechanisms.

  • Develop clean, reusable, testable, and maintainable code primarily using Python and PySpark.

  • Implement and maintain automated deployment processes using CI/CD and infrastructure-as-code practices, including GitHub Actions and Terraform.

  • Troubleshoot data-quality, pipeline-performance, and production issues and identify appropriate long-term solutions.

  • Produce appropriate technical documentation covering data lineage, pipeline design, business rules, dependencies, and operational procedures.

  • Collaborate effectively with data platform, business, Middle Office, and downstream technology teams.

Recruiter Details

Contact: Sohail -


Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10498904
  • Position Id: 36626-2053-1795016511
  • Posted 2 hours ago

Company Info

About GSK Solutions Inc.

Our values are integrity, leading change, excellence, and respect for the individual, learning and sharing. Our success is based on our ability to be flexible while adhering to a strict project management methodology.

We inspire personal and professional growth in our people through innovation and creativity. We reward excellence. We earn the trust of our customers and the respect of our employees through exceptional teamwork, good business ethics and a high level of commitment

About_Company_OneAbout_Company_Two
Contact the job poster
Ram Krishna

Ram Krishna

Recruiter @ GSK Solutions Inc.

Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.