Software Dev Engineer II Software Dev Engineer II

Position: Data Engineer
Location: CA - 100% Remote
Interview Mode - Video
Duration: 12+ months

Core Technical Skills
1. Python (Required)

• Years of experience:
• Describe a production-grade data pipeline you've developed using Python.

2. SQL (Required)

• Comfort level with complex queries (joins, windows, CTEs):
• Share an example of a query you've written for analytical purposes.

3. Distributed Data Processing (Required)

• Tools used (select all that apply): Spark, Flink, Beam
• Which one(s) have you used in production, and for what purpose?
• Describe a project where one of these tools was key for performance, scale, or streaming.

4. Cloud Platforms (Google Cloud Platform or AWS)

• Platforms used:
• Experience with:
  • AWS EMR
  • Google Cloud Platform BigQuery
  • Google Dataproc
  • Google Cloud Run
  • Cloud-native storage (e.g., S3, GCS)
  • Relevant cloud APIs

5. Orchestration Tools

• Tools used: (Airflow, Prefect, Dagster, Google Cloud Workflows, etc.)
• How have you managed retries, alerts, dependencies, or branching logic?

6. dbt / Dataform (Nice to Have)

• Experience level:
• Approach to managing models, testing, and deployment environments

7. CI/CD and Git

• Git strategy familiarity:
• Tools used for automating pipeline deployment or testing

8. Java (Nice to Have)

• Years of experience:
• What types of data-related or backend projects have you used Java for?

Platform & Architecture
9. Data Warehouse Experience

• Have you worked with:
  • BigQuery
  • Snowflake
  • Dremio
  • Hive (Nice to Have)
  • Oracle (Nice to Have)
• Describe a migration or integration project involving one of these systems.

10. Schema Design & ELT Pipelines

• What's your approach to designing scalable, testable ELT workflows?
• Any experience optimizing for performance or cost?

11. Streaming / Real-time Data Tools

• Experience with Kafka, Spark Streaming, Flink, or Beam:
• Use case and your role in implementation

Soft Skills & Remote Readiness
12. Independent Work

• This role is remote and requires autonomy. Share an example of successfully delivering a solution independently.

13. Troubleshooting

• Describe a time you had to debug a complex data issue. What tools or methods did you use?

Pre-Qualification Checklist
Skill / Tool
Required
Confirmed (Yes/No)
Notes
Python
Yes

SQL
Yes

Spark / Flink / Beam
Yes

Google Cloud Platform or AWS
Yes

BigQuery / EMR
Yes

Dataproc
Yes

Cloud Run
Yes

Airflow / Prefect / Dagster
Yes

Google Cloud Workflows
Yes

Git / CI/CD
Yes

dbt / Dataform
Nice to Have

Java
Nice to Have

Hive
Nice to Have

Oracle
Nice to Have

Communication & Autonomy
Yes

#TB_EN