Senior Data Engineer

Overview

Remote
On Site
USD0 - USD0
Contract - W2

Skills

Senior
Data
Engineer
USC/GC

Job Details

STRATEGIC STAFFING SOLUTIONS (S3) HAS AN OPENING!

Strategic Staffing Solutions is currently looking for a Data Engineer IV, for one of its clients!!

Job Title: Senior Data Engineer
Location: Charlotte, NC
Setting: Hybrid/remote
Duration: 12 months
Candidates should be willing to work on our W2 ONLY.NO C2C/1099/complete the Glider assessment to be considered for this role.

Top Skills:

Apache Flink
AWS Lake Formation
Kubernetes
Python
Terraform
AWS Glue

Job Summary:

We are specifically looking for individuals with at least 5+ years of experience in Data Engineering and/or Software Engineering roles who can provide knowledge and support to our existing engineers.

Must have experience with similar platform engineering/management solutions:

Building/optimizing Data Lake House with Open Table formats
Kubernetes deployments/cluster administration
Transitioning on-premise big data platforms to scalable cloud-based platforms like AWS
Distributed Systems, Microservice architecture, and containers
Cloud Streaming use cases in Big Data Ecosystems (e.g., EMR, EKS, Hadoop, Spark, Hudi, Kafka/Kinesis)

Must have experience with the below tech stack:
GitHub Hib and GitHub Actions
AWS
o IAM
o API Gateway
o Lambda
o Step Functions
o Lake formation
o EKS & Kubernetes
o Glue: Catalog, ETL, Crawler
o Athena
o Lambda
o S3 (Strong foundational concepts like object data store vs block data store, encryption/decryption, storage tiers etc)
Apache Hudi
Apache Flink
PostgreSQL and SQL
RDS (Relational Database Services).
Python
Java
Terraform Enterprise
o Must be able to explain what TF is used for
o Understand and explain basic principles (e.g. modules, providers, functions)
o Must be able to write and debug TF
Helpful tech stack experience would include:
Helm
Kafka and Kafka Schema Registry
AWS Services: CloudTrail, SNS, SQS, CloudWatch, Step Functions, Aurora, EMR, Redshift, Iceberg
Secrets Management Platform: Vault, AWS Secrets manager


Core Responsibilities and Soft Skills


  • Provides technical direction, engage team in discussion on how to best guide/build features on key technical aspects and responsible for product tech delivery
  • Works closely with the Product Owner and team to align on delivery goals and timing
  • Collaborates with architects on key technical decisions for data and overall solution
  • Lead design and implementation of data quality check methods
  • Ensure data security and permissions solutions, including data encryption, user access controls and logging
  • Be able to think unconventionally to find the best way to solve for a defined use case with fuzzy requirements.
  • Willing to do their own research to solve problems and can clearly present findings and engage in conversation on what makes one solution better than another
  • Thrive in a fail-fast environment, involving mini PoCs, and participate in an inspect and adapt process.
  • Questioning and Improvement mindset
  • Must be ready to ask questions about why something is currently done the way it is and suggest alternative solutions
  • Customer-facing skills
  • Interfacing with stakeholders and other product teams via pairing, troubleshooting support, and debugging issues they encounter with our products





Beware of scams. S3 never asks for money during its onboarding process.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Strategic Staffing Solutions