Lead Data Engineer

Remote • Posted 4 hours ago • Updated 4 hours ago
Full Time
Remote
Fitment

Dice Job Match Score™

👤 Reviewing your profile...

Job Details

Skills

  • IT Management
  • Analytics
  • Data Loading
  • Unstructured Data
  • Real-time
  • Product Engineering
  • Data Processing
  • Data Integrity
  • Continuous Improvement
  • Scalability
  • Data Governance
  • Regulatory Compliance
  • Computer Science
  • Data Engineering
  • Extract
  • Transform
  • Load
  • SQL
  • Python
  • Programming Languages
  • Cloud Computing
  • Amazon Web Services
  • Google Cloud
  • Google Cloud Platform
  • Big Data
  • Apache Hadoop
  • Apache Spark
  • Apache Kafka
  • Distributed Computing
  • Data Lake
  • Amazon Redshift
  • Continuous Integration
  • Continuous Delivery
  • Data Modeling
  • Data Warehouse
  • Data Management
  • Communication
  • Leadership
  • Collaboration
  • Microsoft Azure
  • Databricks
  • Snow Flake Schema
  • ADA
  • Human Resources
  • Forms
  • English
  • Spanish

Summary

Job Description:

As the Technical Lead Data Engineer, your primary responsibility will be to spearhead the design, development, and implementation of data solutions aimed at empowering our organization to derive actionable insights from intricate datasets. You will take the lead in guiding a team of data engineers, fostering collaboration with cross-functional teams, and spearheading initiatives geared towards fortifying our data infrastructure, CI/CD pipelines, and analytics capabilities.

Responsibilities:

  • Apply advanced knowledge of Data Engineering principles, methodologies and techniques to design and implement data loading and aggregation frameworks across broad areas of the organization.

  • Gather and process raw, structured, semi-structured and unstructured data using batch and real-time data processing frameworks.

  • Implement and optimize data solutions in enterprise data warehouses and big data repositories, focusing primarily on movement to the cloud.

  • Drive new and enhanced capabilities to Enterprise Data Platform partners to meet the needs of product / engineering / business.

  • Experience building enterprise systems especially using Databricks, Snowflake and platforms like Azure, AWS, Google Cloud Platform, etc.

  • Leverage strong Python, Spark, SQL programming skills to construct robust pipelines for efficient data processing and analysis.

  • Implement CI/CD pipelines for automating build, test, and deployment processes to accelerate the delivery of data solutions.

  • Implement data modeling techniques to design and optimize data schemas, ensuring data integrity and performance.

  • Drive continuous improvement initiatives to enhance performance, reliability, and scalability of our data infrastructure.

  • Collaborate with data scientists, analysts, and other stakeholders to understand business requirements and translate them into technical solutions.

  • Implement best practices for data governance, security, and compliance to ensure the integrity and confidentiality of our data assets.

Qualifications:

  • Bachelor's or master's degree in computer science, Engineering, or a related field.

  • Proven experience (8+) in a data engineering role, with expertise in designing and building data pipelines, ETL processes, and data warehouses.

  • Strong proficiency in SQL, Python and Spark programming languages.

  • Strong experience with cloud platforms such as AWS, Azure, or Google Cloud Platform is a must.

  • Hands-on experience with big data technologies such as Hadoop, Spark, Kafka, and distributed computing frameworks.

  • Knowledge of data lake and data warehouse solutions, including Databricks, Snowflake, Amazon Redshift, Google BigQuery, Azure Data Factory, Airflow etc.

  • Experience in implementing CI/CD pipelines for automating build, test, and deployment processes.

  • Solid understanding of data modeling concepts, data warehousing architectures, and data management best practices.

  • Excellent communication and leadership skills, with the ability to effectively collaborate with cross-functional teams and drive consensus on technical decisions.

  • Relevant certifications (e.g., Azure, databricks, snowflake) would be a plus.

Circle K is an Equal Opportunity Employer.
The Company complies with the Americans with Disabilities Act (the ADA) and all state and local disability laws. Applicants with disabilities may be entitled to a reasonable accommodation under the terms of the ADA and certain state or local laws as long as it does not impose an undue hardship on the Company. Please inform the Company's Human Resources Representative if you need assistance completing any forms or to otherwise participate in the application process.


Click below to review information about our company's use of the federal E-Verify program to check work eligibility:

In English

In Spanish
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: RTL141498
  • Position Id: 2dece8bc412e9d40e7c23d6fd6566210
  • Posted 4 hours ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Remote or Arlington, Virginia

Today

Full-time

USD 113,000.00 - 188,000.00 per year

Remote

Today

Full-time

USD 102,000.00 - 170,000.00 per year

Remote or Denver, Colorado

Today

Full-time

USD 155,000.00 - 185,000.00 per year

Remote

Today

Full-time

USD 160,000.00 - 195,000.00 per year

Search all similar jobs