Search Jobs | Dice.com

2 results (1 new)

Group by company

Sr. Data Engineer # 26-27370

U.S. Tech Solutions Inc.

Remote • Today

Easy Apply

Contract

$90 - $105

Sr. Analyst - II/Senior Data Engineer & BI Developer # 26-26828

U.S. Tech Solutions Inc.

Foster City, California • 6d ago

Easy Apply

Contract

$98.53 - $98.54

Job Details

Skills

PYTHON
TERRAFORM
LAMBDA
GLUE
PIPELINE
PIPELINES
KAFKA
DATA STREAM
DATA STREAMS
DATA STREAMING
PYSPARK
ATHENA
REDSHIFT
AWS

Summary

Duration: 12 months contract with extensions
Shift: Remote role

Key Responsibilities

Design, develop, and maintain scalable ETL pipelines using AWS Glue, EMR (PySpark), and Lambda functions
Implement real-time data streaming solutions using Confluent Kafka with source and sink connectors
Develop and optimize PySpark jobs on EMR clusters for large-scale data transformations
Build serverless data processing workflows using AWS Lambda
Design and optimize queries in AWS Athena for analytical workloads
Manage data warehouse solutions in AWS Redshift including data modeling and performance tuning
Implement monitoring and alerting using CloudWatch for data pipeline health and performance
Provision and manage AWS infrastructure using Terraform
Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements
Implement data governance and security best practices using Lake Formation, IAM, and KMS

Required Technical Skills

Python: Advanced proficiency in Python 3.8+ for data processing, scripting, and automation
PySpark: Extensive experience with PySpark for large-scale data processing and transformations on EMR clusters
AWS Lambda: Hands-on experience building serverless functions for data processing and orchestration
AWS Glue: Expertise in AWS Glue for ETL jobs, Data Catalog management.
AWS Athena: Experience with Athena for SQL-based data analysis and querying data lakes
AWS EMR: Strong experience with EMR for running Spark jobs, EMR Notebooks, and cluster management
AWSRedshift: Knowledge of Redshift for data warehousing, query optimization, and integration with data lakes
Kafka: Experience with Confluent Kafka for real-time data streaming, including Schema Registry, source/sink connectors, and producers/consumers
AWS S3: Deep understanding of S3 for data lake architecture, bucket policies, and data organization (raw, curated layers)
CloudWatch: Proficiency in CloudWatch for logging, monitoring, and alerting on data pipelines
Terraform: Experience with Infrastructure as Code using Terraform for provisioning AWS resources

Additional Technical Experience

Knowledge of AWS EventBridge and Step Functions for workflow orchestration
Familiarity with EMR runtime roles and execution roles for secure data access
Experience with DynamoDB for NoSQL data storage
Knowledge of API Gateway for building data APIs

Preferred Qualifications

Bachelor's degree in Computer Science, Data Engineering, Information Technology, or related field
Strong understanding of distributed computing and big data processing frameworks
Experience with Agile development methodologies
Excellent problem-solving and analytical skills
Strong communication and collaboration abilities

Development and Data Tools

EMR Notebooks or Jupyter for interactive development
VS Code or similar IDE for Python development
Git for version control
AWS CLI and boto3 for AWS service interaction
Terraform for infrastructure provisioning
DBeaver, Data Studio for database management

About US Tech Solutions:
US Tech Solutions is a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions. To know more about US Tech Solutions, please visit

US Tech Solutions is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

By applying, you acknowledge that AI-assisted tools may be used during hiring.

#LI-AS140

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: usts
Position Id: 26-27370
Posted 12 hours ago

Fitment

Dice Job Match Score™

To see how well you match this job, please log in or create an account.

Once logged in, be sure to complete your profile to get the most accurate match score.

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Data Engineer

Remote

•

Today

Description: Remote Our client seeks a Data Engineer to design and implement high-performance data pipelines at scale. The role will focus on building reliable ingestion and transformation processes, enforcing data quality and lineage, and delivering resilient solutions across AWS services. Due to client requirements, applicants must be willing and able to work on a w2 basis. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k wit

Contract

Data Engineer

Remote or New York, New York

•

Today

RESPONSIBILITIES: Kforce's client in NYC is seeking a highly skilled Data Engineer with strong hands-on experience in Apache Spark/PySpark, AWS EMR, Databricks, and Snowflake. The Data Engineer will be responsible for designing and building scalable, high-volume data pipelines, optimizing distributed data processing workloads, implementing data quality and observability frameworks, and resolving complex performance and production challenges across cloud-based data platforms. REQUIREMENTS: * Str

Contract

$74 - $74 hourly

Data Automation Engineer

Remote or Washington, District of Columbia

•

Today

Description We are looking for a Data Automation Engineer to design, develop, and maintain scalable data automation solutions leveraging AWS cloud services, selected Azure technologies, and emerging Generative AI capabilities. Key Responsibilities: Design and implement scalable data automation workflows using AWS services with integration to Azure platforms. Develop and maintain ETL/ELT processes to ingest, transform, and move data across DynamoDB, SQL Server, Azure SQL, and other enterprise da

Easy Apply

Contract

USD 48.00 - 54.00 per hour

AWS Lakehouse Data Engineer

Remote

•

14d ago

Job Title: AWS Lakehouse Data Engineer Work Model: Remote offsite Responsibilities Build and operate data pipelines (batch and streaming) from APIs, relational databases, file drops, event streams, and external partners. Design, implement, test, and optimize ETL/ELT pipelines using Python and PySpark to produce analytics-ready datasets for reporting, visualization, and machine learning. Implement incremental processing, change data capture (CDC), data contracts, schema validation, and reusable

Easy Apply

Contract

Depends on Experience

Job Details

Skills

PYTHON
TERRAFORM
LAMBDA
GLUE
PIPELINE
PIPELINES
KAFKA
DATA STREAM
DATA STREAMS
DATA STREAMING
PYSPARK
ATHENA
REDSHIFT
AWS

Summary

Duration: 12 months contract with extensions
Shift: Remote role

Key Responsibilities

Design, develop, and maintain scalable ETL pipelines using AWS Glue, EMR (PySpark), and Lambda functions
Implement real-time data streaming solutions using Confluent Kafka with source and sink connectors
Develop and optimize PySpark jobs on EMR clusters for large-scale data transformations
Build serverless data processing workflows using AWS Lambda
Design and optimize queries in AWS Athena for analytical workloads
Manage data warehouse solutions in AWS Redshift including data modeling and performance tuning
Implement monitoring and alerting using CloudWatch for data pipeline health and performance
Provision and manage AWS infrastructure using Terraform
Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements
Implement data governance and security best practices using Lake Formation, IAM, and KMS

Required Technical Skills

Python: Advanced proficiency in Python 3.8+ for data processing, scripting, and automation
PySpark: Extensive experience with PySpark for large-scale data processing and transformations on EMR clusters
AWS Lambda: Hands-on experience building serverless functions for data processing and orchestration
AWS Glue: Expertise in AWS Glue for ETL jobs, Data Catalog management.
AWS Athena: Experience with Athena for SQL-based data analysis and querying data lakes
AWS EMR: Strong experience with EMR for running Spark jobs, EMR Notebooks, and cluster management
AWSRedshift: Knowledge of Redshift for data warehousing, query optimization, and integration with data lakes
Kafka: Experience with Confluent Kafka for real-time data streaming, including Schema Registry, source/sink connectors, and producers/consumers
AWS S3: Deep understanding of S3 for data lake architecture, bucket policies, and data organization (raw, curated layers)
CloudWatch: Proficiency in CloudWatch for logging, monitoring, and alerting on data pipelines
Terraform: Experience with Infrastructure as Code using Terraform for provisioning AWS resources

Additional Technical Experience

Knowledge of AWS EventBridge and Step Functions for workflow orchestration
Familiarity with EMR runtime roles and execution roles for secure data access
Experience with DynamoDB for NoSQL data storage
Knowledge of API Gateway for building data APIs

Preferred Qualifications

Bachelor's degree in Computer Science, Data Engineering, Information Technology, or related field
Strong understanding of distributed computing and big data processing frameworks
Experience with Agile development methodologies
Excellent problem-solving and analytical skills
Strong communication and collaboration abilities

Development and Data Tools

EMR Notebooks or Jupyter for interactive development
VS Code or similar IDE for Python development
Git for version control
AWS CLI and boto3 for AWS service interaction
Terraform for infrastructure provisioning
DBeaver, Data Studio for database management

Dice Id: usts
Position Id: 26-27370
Posted 12 hours ago

Fitment

Dice Job Match Score™

To see how well you match this job, please log in or create an account.

Once logged in, be sure to complete your profile to get the most accurate match score.

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Data Engineer

Remote

•

Today

Contract

Data Engineer

Remote or New York, New York

•

Today

Contract

$74 - $74 hourly

Data Automation Engineer

Remote or Washington, District of Columbia

•

Today

Easy Apply

Contract

USD 48.00 - 54.00 per hour

AWS Lakehouse Data Engineer

Remote

•

14d ago

Easy Apply

Contract

Depends on Experience