Overview
On Site
Hybrid
BASED ON EXPERIENCE
Contract - W2
Contract - Independent
Skills
PYTHON
SQL
AIRFLOW
JAVA
SCALA
KAFKA
SPARK
TRINO
Job Details
Job Title: Senior Data Engineer
Location: Cupertino, CA or Austin, TX (Hybrid)
Duration : Long Term
Must Have: Python, SQL, and Airflow
Nice to Have: Java or Scala, or Spark, Trino, Kafka, or Kubernetes
Required Qualifications
Preferred Qualifications
Location: Cupertino, CA or Austin, TX (Hybrid)
Duration : Long Term
Must Have: Python, SQL, and Airflow
Nice to Have: Java or Scala, or Spark, Trino, Kafka, or Kubernetes
Job Overview
We are seeking an experienced and detail-oriented Senior Data Engineer to join a high-impact business development and strategy team. This role is ideal for a data-driven individual who enjoys solving complex business problems and thrives in a fast-paced, evolving environment. You will be instrumental in building and optimizing scalable data solutions that empower leadership to make data-informed decisions quickly and confidently.
Key Responsibilities
- Architect, develop, and test large-scale, high-efficiency data solutions.
- Design scalable methods to consume and process data from diverse, often unpredictable sources.
- Create self-service data products that promote predictability and ease of use across teams.
- Build reusable libraries and frameworks that enhance team productivity.
- Optimize and maintain data pipelines and systems for performance, quality, and operational excellence.
- Collaborate cross-functionally with data analysts, product teams, and engineering stakeholders to align on data strategy and execution.
Required Qualifications
- 6+ years of software/data engineering experience with a strong focus on SQL and data systems.
- Proficiency in programming languages such as Python, Java, or Scala.
- Hands-on experience with data orchestration and processing tools like Airflow, Spark, Trino, and Kafka.
- Proven ability to analyze complex datasets and implement high-quality, efficient solutions.
- Familiarity with SDLC best practices, version control systems, and CI/CD pipelines.
Preferred Qualifications
- Bachelor s or Master s degree in Computer Science, Engineering, or a related technical field.
- Experience with cloud platforms such as AWS, Google Cloud Platform (Google Cloud Platform), or Azure for data infrastructure and storage.
- Familiarity with Infrastructure as Code (IaC) tools like Terraform.
- Understanding of container orchestration tools such as Kubernetes.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.