Lead Data Engineer/ Architect

Remote • Posted 11 days ago • Updated 11 days ago

Full Time

Remote

$120,000 - $140,000/yr

Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

Python
PL/SQL
DBT
Airflow
BigQuery

Summary

Mandatory Skills: Python, PL/SQL, DBT, Airflow, BigQuery, do not send resume if candidate is not meeting the requirements.

Technical Skills:

Python: Programming, ETL scripting, business logic implementation, and experience with data manipulation libraries (pandas, NumPy).
PL/SQL: Data transformation, view/table creation, and persistence layer interactions.
Data Transformation Tools: DBT (Data Build Tool) for creating models and documentation.

Orchestration and Data Processing Tools
Orchestration: Airflow, Dataflow, and Cloud Composer.
Data Ingestion: Cloud Functions, Cloud Run, SFTP mechanisms, and Falcon (for database connections).

Cloud Platform:

Google Cloud Platform (Google Cloud Platform) and BigQuery experience.
Experience with cloud-native data processing.

Additional Desired Skills:

Understanding of householding and data segmentation logic.
Ability to work with streaming and batch data.
Experience with data integration from multiple sources (e.g., Reltio, external databases).
Familiarity with incremental data loading and partitioning strategies.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 501494924
Position Id: 8879600
Posted 11 days ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Lead Data Engineer/ Architect

Dice Job Match Score™

Job Details

Skills

Summary

Similar Jobs