Data Engineer - Austin, TX / Cupertino, CA

Job Title: Data Engineer - Austin, TX / Cupertino, CA

Location: Cupertino, CA

Work Type: Hybrid (Tue, Wed, Thur - Office)

Duration: Long term Contract on W2

Responsibilities

• Design, implement, and maintain data pipelines using Python (PySpark) and SQL
• Manage data stores containing millions of records and insure availability, security, and scalability
• Collaborate with data scientists, business partners, and engineering groups to identify performance indicators from complex data sets, then create visualizations for these indicators, metrics, and trends

Minimum Qualifications

• 3-5 years of experience in Data Engineering or similar role
• 3-5 years of experience in Python and SQL
• 3-5 years of experience with data schema design and data modeling
• Bachelors degree in Computer Science, Data Science, Mathematics, or related field, or equivalent experience
• Experience creating data visualizations that tell compelling stories using tools such as Tableau, D3, Plotly, or Observable

Preferred Qualifications

• Experience with PySpark or Scala is a big plus
• Experience with NoSQL datastores (such as HBase, Cassandra, MongoDB)
• Experience integrating messaging technologies like Kafka or Flink
• Experience with Big Data Tech such as Apache Spark or Hadoop
• Observability and telemetry tools such as CloudWatch, Splunk, Prometheus, OpenTelemetry
• Ability to build CI pipelines and automation tools using tools such as Jenkins, GitHub Actions,CircleCI, etc.
• Experience with mentoring, guiding, and motivating other team members
• Excellent presentation and communication skills, with strong attention to detail