Apply Now

Large-Scale Data Platforms Engineer - #26-23263

Remote • Posted 20 hours ago • Updated 20 hours ago

Contract W2

12 Months

Remote

$75 - $80/hr

Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

AWS
AZURE
GCP
DATA SET
DATA-SET

Summary

Duration: 12 months contract

Job Description:

We are seeking a Senior Data Engineer to design, build, and operate highly scalable data platforms supporting a large, high-traffic digital business. The role involves massive datasets, complex data flows, and business-critical analytics workloads, where performance, reliability, scalability, and automation are essential.
The ideal candidate has hands-on experience building and operating production-grade data pipelines processing billions of rows/records, with strong expertise across distributed data processing, orchestration, data modeling, monitoring, and optimization.
This is not a dashboard-focused or basic ETL role. We are looking for an engineer who can take complex data problems from business requirements → architecture → pipeline development → data modeling → production deployment → monitoring and optimization, while ensuring high performance, reliability, and scalability.

Responsibilities:

Design and implement scalable, production-grade data pipelines capable of processing billions of rows/records across multiple data sources.
Build reliable data ingestion, transformation, processing, and storage workflows for large-scale analytical and operational use cases.
Develop and optimize distributed data processing solutions using technologies such as Apache Spark.
Build and manage workflow orchestration using Apache Airflow or similar platforms.
Design data pipelines with strong focus on performance, scalability, reliability, recoverability, and operational efficiency.
Monitor production pipelines, identify bottlenecks and failures, and proactively improve data reliability, pipeline uptime, and processing efficiency.
Develop robust data models that translate complex business requirements into clean, scalable, and easily evolvable analytical structures.
Write highly efficient and complex SQL for large-scale data transformation, analysis, validation, and troubleshooting.
Use Python, Java, or Scala to develop scalable data processing and automation solutions.
Identify repetitive manual processes and continuously automate, simplify, and eliminate operational overhead.
Troubleshoot large-scale data and pipeline issues and drive root-cause resolution rather than relying on manual workarounds.

Experience:

Strong experience in Data Engineering / Big Data Engineering within high-volume production environments.
Proven experience designing and operating data pipelines processing billions of rows/records.
Extensive hands-on experience with Apache Spark and distributed data processing.
Strong experience with Apache Airflow or comparable workflow orchestration frameworks.
Advanced proficiency in SQL and experience working with very large datasets.
Strong programming experience in Python, Java, or Scala.
Proven expertise in data modeling, dimensional modeling, analytical data structures, and scalable data architecture.
Experience with production data environments where availability, reliability, latency, scalability, and data quality are critical.
Demonstrated mindset of automation and continuous improvement—you naturally look for ways to eliminate repetitive manual work.

Skillsets:

Experience handling multi-billion-row datasets or similarly high-volume event/data workloads.
Experience with high-traffic consumer platforms, digital products, marketplaces, advertising, search, transaction, or behavioral analytics data.
Experience building data platforms that support near-real-time or high-frequency data processing.
Background in geographic information systems (GIS) or spatial analysis

Education:

Bachelor's degree or equivalent experience in related field.

About US Tech Solutions:
US Tech Solutions is a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions. To know more about US Tech Solutions, please visit .

US Tech Solutions is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

AI Statement: By applying, you acknowledge that AI-assisted tools may be used during hiring.

#LI-AS140

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: usts
Position Id: 26-23263
Posted 20 hours ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Senior Big Query & Spark Data Engineer

Remote

•

5d ago

Job Summary We are looking for an experienced Senior Data Engineer with strong hands-on expertise in Google BigQuery, Apache Spark, PySpark, Python, and SQL. The candidate will design and develop large-scale data pipelines, optimize distributed data-processing workloads, and build scalable analytical data platforms on Google Cloud. Key Responsibilities Design, develop, and maintain scalable ETL/ELT data pipelines using Python, SQL, Spark, and PySpark.Build and optimize enterprise-scale data solu

Easy Apply

Contract

Senior Software Engineer, Data Engineering

Remote

•

Today

Omada Health is on a mission to bend the curve of chronic disease. Job overview: We are dedicated to leveraging data to drive strategic decision-making and operational efficiency. Our team is passionate about harnessing the power of data to solve complex problems and deliver impactful insights. We are seeking a highly skilled and motivated Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining robust data architectures and engineering

Full-time

USD 179,400.00 - 224,300.00 per year

Data Engineer L4 (Remote)

Remote

•

Today

Overview Frontdoor is reimagining how homeowners maintain and repair their most valuable asset - their home. As the parent company of two leading brands, we bring over 50 years of experience in providing our members with comprehensive options to protect their homes from costly and unexpected breakdowns through our extensive network of pre-qualified professional contractors. American Home Shield, the category leader in home service plans with approximately two million members, gives homeowners bu

Full-time

USD 114,000.00 - 145,000.00 per year

Data Engineer

Remote

•

11d ago

APN Consulting, Inc. is a progressive IT staffing and services company offering innovative business solutions to improve client business outcomes. We focus on high impact technology solutions in ServiceNow, Fullstack, Cloud & Data, and AI / ML. Due to our globally expanding service offerings we are seeking top-talent to join our teams and grow with us. Role: Data Engineer Duration: 6 months Location: US Remote Job Description Minimum 5+ years of experience in Data Engineering, Analytics, or rela

Easy Apply

Third Party, Contract

Depends on Experience

Search all similar jobs

Remote jobs at U.S. Tech Solutions Inc.