Senior Lead Data Engineer - R01568572

• Posted 1 day ago • Updated 7 hours ago
Full Time
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Amazon SQS
  • Amazon Kinesis
  • Amazon Redshift
  • Data Engineering
  • Cloud Computing
  • Database Administration
  • Logical Data Model
  • Database Performance Tuning
  • Data Security
  • Data Quality
  • Analytics
  • Usability
  • Unstructured Data
  • JSON
  • SQL
  • Python
  • PySpark
  • Databricks
  • Amazon Web Services
  • Git
  • Continuous Integration
  • Continuous Delivery
  • Collaboration
  • Management
  • Microsoft Power BI
  • Business Intelligence
  • Visualization
  • Data Lake
  • Data Warehouse
  • Streaming
  • Real-time
  • Data Processing
  • SaaS

Summary

Senior Lead Data Engineer
Primary Skills
  • Athena, SNS, SQS, CloudWatch, Kinesis, Redshift
Specialization
  • AWS Data EngineerIng Advanced: Associate Data Engineer
Job requirements
  • The Senior Data Engineer, Platform will play a key role in building and scaling Organization's data and analytics foundation. This role focuses on designing, developing, and operating reliable, scalable, and cost effective data pipelines and platforms in the cloud. The ideal candidate is a hands on data engineer who can design data systems from the ground up while collaborating closely with software engineers, data analysts, and data scientists to enable consistent and high quality data delivery across the organization.
  • Key Responsibilities Design, develop, and operationalize scalable, reliable, and performant cloud based data pipelines. Build and maintain large, complex datasets that meet both functional and non functional business requirements. Apply database management best practices, including logical data modeling, physical database optimization, and data security. Implement and enhance Data Quality checks to ensure accuracy, integrity, and reliability of data pipelines. Partner closely with Data & Analytics experts to continuously enhance data platform capabilities and usability. Support multiple teams, systems, and products by providing consistent and optimized data delivery architectures. Participate in on call support rotations and proactively unblock users based on issue severity and business impact. Contribute to improving operational processes, monitoring, and reliability of data platforms.
  • Required Skills & Experience 5+ years of experience designing, building, and operationalizing data pipelines for large and complex datasets. Strong experience working with structured and unstructured data, including JSON. Extensive hands on experience with advanced SQL for data transformation and analysis. 3+ years of experience with Python and PySpark for large scale data processing. Hands on experience transforming and processing data using Databricks. 3+ years of experience building data solutions on AWS. Experience using Git and CI/CD practices for data and platform development. Strong collaboration skills with the ability to support data engineers, analysts, data scientists, and software engineers. Self directed, ownership driven mindset with the ability to manage multiple concurrent priorities.
  • Nice to Have Skills Experience with Power BI or similar business intelligence and visualization tools. Familiarity with modern data lake and data warehouse architectures. Experience implementing observability, monitoring, and alerting for data pipelines. Exposure to streaming data technologies or near real time data processing. Experience in a fast growing, platform focused or SaaS environment.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 90672149
  • Position Id: 2e8b077247233823245a92f90039a1ec
  • Posted 1 day ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Hybrid in Bethesda, Maryland

Yesterday

Easy Apply

Full-time

Depends on Experience

New York, New York

Today

Full-time

USD 165,000.00 - 220,000.00 per year

Plano, Texas

Today

Full-time

Remote or Minnetonka, Minnesota

Today

Full-time

USD 91,700.00 - 163,700.00 per year

Search all similar jobs