Apply Now

Big Data Engineer

Phoenix, AZ, US • Posted 1 hour ago • Updated 1 hour ago

Contract Independent

Contract W2

Travel Required

Able to Sponsor

On-site

$50/hr

TechVirtue LLC

Fitment

Dice Job Match Score™

🫥 Flibbertigibetting...

Job Details

Skills

Big Data Engineer
Big Data
Apache Spark
Spark SQL
Spark Core
DataFrames
SQL
stored procedures
Spark
ETL
ELT
structured
unstructured
data platforms
data lake
BigQuery
Query Optimization

Summary

Job Title: Big Data Engineer
Location: Phoenix, AZ
Duration: 12+ Months

Females are preffered

Job Description:
Design, develop, and optimize large-scale data processing pipelines using Apache Spark (Spark SQL, Spark Core, and DataFrames) for high-volume batch and real-time data workloads.
Write complex and high-performance SQL queries, stored procedures, and data transformations to support data ingestion, cleansing, aggregation, and reporting requirements.
Perform advanced performance tuning and troubleshooting of Spark jobs and SQL workloads, including partitioning, joins, caching, and query optimization for improved efficiency.
Build and maintain ETL/ELT workflows by integrating data from multiple structured and unstructured sources into enterprise data platforms and data lakes.
Work with BigQuery for data analysis, query optimization, and large-scale analytical reporting; knowledge of schema design and cost-efficient query execution is an added advantage.
Collaborate with cross-functional teams including Data Architects, Analysts, and DevOps teams to ensure scalable, secure, and reliable big data solutions aligned with business requirements.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91170837
Position Id: 8964026
Posted 1 hour ago

Company Info

About TechVirtue LLC

TechVirtue is involved in developing a wide range of solutions in finding the perfect candidate who has a strong knowledge in his/her work and suits the company's work culture. We even provide one-stop solutions ranging from software development and maintenance to expert support and advisory. Our team consists of experts who have several years of experience in staffing, recruitment, and web development. Our dedicated and motivated team makes sure to fulfill all our customers requirements.

Go to company profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Big Data Engineer

Phoenix, Arizona

•

Today

Role: Big Data Engineer Location: Phoenix, AZ - Onsite Duration: 12+ Months Job Description: Design, develop, and optimize large-scale data processing pipelines using Apache Spark (Spark SQL, Spark Core, and DataFrames) for high-volume batch and real-time data workloads. Write complex and high-performance SQL queries, stored procedures, and data transformations to support data ingestion, cleansing, aggregation, and reporting requirements. Perform advanced performance tuning and troubleshooti

Easy Apply

Contract

$50+

Senior SQL/MSBI/Database Developer

Washington, District of Columbia

•

2d ago

Job Title: Senior SQL/BI/Database Developer Location: Washington, DC Duration: Long Term Contract Face to Face client interview in washington, DC Required Qualifications: Developing custom SQL Server applications and code (using T-SQL), building and supporting robust ETL applications (using both T-SQL and SSIS) 7+ years of experience working with databases, preferably SQL Server. 7+ years of experience in developing ETL processes, including the use of SSIS packages in a Microsoft SQL Server data

Easy Apply

Contract

Senior MSBI/SQL Server Developer - C2C/W2 - Contract - Washington - DC - Hybrid

Hybrid in Washington, District of Columbia

•

2d ago

Role: Senior DB Application Developer/SQL Server Developer Contract Location: Washington, DC (Hybrid 3 days onsite) Eligible Candidates: Washington, DC | Maryland | Virginia Engagement: Contract W2/ C2C. Need to go for Face 2 Face for final round!! Skills required: SSIS, T- SQL, ETL, Fabric The Senior Database Application Development Associate will work as part of the Application Development Department alongside other SQL Server Developers within the DBA/Development team. This role involves d

Easy Apply

Contract

45 - 50

Search all similar jobs