Senior Data Engineer

Overview

Remote
$125000 - $130000 per annum
Full Time

Skills

Senior Data Engineer

Job Details



Title: Senior Data Engineer


Location: REMOTE


Pay Rate: $125,000/year + Bonus



Overview:


We are seeking a Senior Data Engineer to join our Agile team. This role is responsible for designing and optimizing scalable data pipeline architectures, enabling data flow across the organization. The ideal candidate will collaborate with cross-functional teams including developers, database architects, analysts, and data scientists to ensure reliable data delivery systems. This position also involves mentoring junior engineers and contributing to the development of data-driven tools and analytics platforms.



Key Responsibilities


Data Engineering & Development



  • Design, assemble, and maintain large, complex data sets that meet functional and non-functional business requirements.

  • Build and optimize data pipelines using AWS services (Python, PySpark, EC2, S3, Glue, Lambda, and Delta Lake).

  • Develop IaC using Terraform and contribute to CI/CD pipelines for automated deployment.

  • Implement cloud-based data solutions and microservices architectures.

  • Create analytics tools and dashboards that generate actionable business insights.

  • Write and maintain clean, efficient, testable, and well-documented code.

  • Collaborate on design and code reviews.


Production Support



  • Perform regular system maintenance and upgrades.

  • Troubleshoot production issues, including those involving third-party applications.

  • Anticipate data and infrastructure challenges, proposing and implementing solutions.


Team Collaboration & Leadership



  • Collaborate with stakeholders to understand data needs and translate them.

  • Participate in Agile ceremonies and cross-functional meetings.

  • Mentor junior team members.



Requirements



  • Strong experience with Python and PySpark for data processing and automation.

  • Proficient in Terraform and Git-based version control workflows.

  • Hands-on experience building & maintaining CI/CD pipelines.

  • Familiarity with message queuing, stream processing, and distributed data architectures.

  • Strong understanding of DevOps and infrastructure automation practices.

  • Ability to perform root cause analysis on data issues and identify improvement opportunities.


Education & Experience



  • Bachelor's degree in Computer Science, Information Systems, or a related field (preferred).

  • 5+ years of experience in Python and building data pipelines.

  • 3+ years working with AWS cloud data services and IaC.

  • 2+ years of CI/CD pipeline development.



Beacon Hill is an equal opportunity employer and individuals with disabilities and/or protected veterans are encouraged to apply.


California residents: Qualified applications with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act.


If you would like to complete our voluntary self-identification form, please or copy and paste the following link into an open window in your browser: ;/p>

Completion of this form is voluntary and will not affect your opportunity for employment, or the terms or conditions of your employment. This form will be used for reporting purposes only and will be kept separate from all other records.


Company Profile:

Beacon Hill Technologies, a premier National Information Technology Staffing Group, provides world class technology talent across all industries utilizing a complete suite of staffing services. Beacon Hill Technologies' dedicated team of recruiting and staffing experts consistently delivers quality IT professionals to solve our customers' technical and business needs.

Beacon Hill Technologies covers a broad spectrum of IT positions, including Project Management and Business Analysis, Programming/Development, Database, Infrastructure, Quality Assurance, Production/Support and ERP roles.


Learn more about Beacon Hill and our specialty divisions, Beacon Hill Associates, Beacon Hill Financial, Beacon Hill HR, Beacon Hill Legal, Beacon Hill Life Sciences and Beacon Hill Technologies by visiting .


Benefits Information:


Beacon Hill offers a robust benefit package including, but not limited to, medical, dental, vision, and federal and state leave programs as required by applicable agency regulations to those that meet eligibility. Upon successfully being hired, details will be provided related to our benefit offerings.




We look forward to working with you.

Beacon Hill. Employing the Future

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Beacon Hill