Overview
Remote
Depends on Experience
Contract - W2
Contract - Independent
Contract - 1 Year(s)
Able to Provide Sponsorship
Skills
Apache Spark
API
Cloud Computing
Amazon Redshift
Data Quality
Computer Science
Data Governance
Extract
Transform
Load
Data Lake
Google Cloud Platform
Orchestration
Scalability
Project Management
Good Clinical Practice
Java
Regulatory Compliance
Job Details
Role : Lead Data Engineer
Location : Remote
Key Responsibilities:
Location : Remote
Key Responsibilities:
- Design, build, and maintain scalable data pipelines and ETL/ELT workflows.
- Lead the data engineering team: mentor junior engineers, provide technical guidance, and conduct code reviews.
- Architect data solutions for ingestion, storage, and real-time processing across structured and unstructured data.
- Implement and manage data lake, data warehouse, and data mesh solutions as needed.
- Ensure data quality, reliability, security, and compliance with data governance standards.
- Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions.
- Optimize data systems for performance, scalability, and cost-effectiveness.
- Stay current with emerging technologies and propose adoption where beneficial.
- Bachelor's or Master's degree in Computer Science, Engineering, or related field.
- 12+ years of experience in data engineering or software engineering.
- Strong proficiency in SQL and Python/Scala/Java.
- Hands-on experience with cloud platforms (AWS, Azure, or Google Cloud Platform) and big data tools (Spark, Kafka, Hadoop).
- Expertise with data warehousing technologies (Snowflake, BigQuery, Redshift, etc.).
- Experience with orchestration tools (Airflow, Dagster, Prefect, etc.).
- Solid understanding of data modeling, distributed systems, and API integration.
- Proven leadership experience and project management skills.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.