![]()
Location: Hybrid Wayne, PA (2 days on site/ week required)
We are seeking a Data Engineer with strong hands-on experience in Azure Databricks and modern data pipeline development. This role will focus on building and optimizing data pipelines, developing scalable data solutions, and working with structured and semi-structured data in cloud environments.
Key Responsibilities
- Design, develop, and maintain data pipelines using Azure Databricks and related Azure services
- Build and optimize ETL/ELT workflows to support data ingestion, transformation, and processing
- Work with large datasets using PySpark and Databricks notebooks to deliver efficient data solutions
- Implement data transformations, validations, and performance optimizations across pipelines
- Collaborate with data architects, analysts, and business stakeholders to understand data requirements
- Assist in troubleshooting data pipeline issues and improving system reliability and performance
- Support integration with Azure Data Factory for orchestration and pipeline workflows
- Ensure data quality, consistency, and accuracy across datasets and downstream systems
- Participate in code reviews and contribute to best practices for data engineering standards
Required Qualifications
- 3+ years of data engineering experience
- Hands-on experience with Azure Databricks
- Strong SQL skills for querying, transformation, and data validation
- Experience with Python and PySpark for data processing
- Familiarity with Azure Data Factory for pipeline orchestration
- Experience working with data pipelines beyond simple ingestion (transformations, optimization, scaling)
- Ability to pass a hands-on coding assessment in Databricks / PySpark / SQL
Beacon Hill is an equal opportunity employer and individuals with disabilities and/or protected veterans are encouraged to apply.
California residents: Qualified applications with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act.
If you would like to complete our voluntary self-identification form, please or copy and paste the following link into an open window in your browser: ;/p>
Completion of this form is voluntary and will not affect your opportunity for employment, or the terms or conditions of your employment. This form will be used for reporting purposes only and will be kept separate from all other records.
Company Profile:
Beacon Hill Technologies, a premier National Information Technology Staffing Group, provides world class technology talent across all industries utilizing a complete suite of staffing services. Beacon Hill Technologies' dedicated team of recruiting and staffing experts consistently delivers quality IT professionals to solve our customers' technical and business needs.
Beacon Hill Technologies covers a broad spectrum of IT positions, including Project Management and Business Analysis, Programming/Development, Database, Infrastructure, Quality Assurance, Production/Support and ERP roles.
Learn more about Beacon Hill and our specialty divisions, Beacon Hill Associates, Beacon Hill Financial, Beacon Hill HR, Beacon Hill Legal, Beacon Hill Life Sciences and Beacon Hill Technologies by visiting .
Benefits Information:
Beacon Hill offers a robust benefit package including, but not limited to, medical, dental, vision, and federal and state leave programs as required by applicable agency regulations to those that meet eligibility. Upon successfully being hired, details will be provided related to our benefit offerings.
We look forward to working with you.
Beacon Hill. Employing the Future
Never miss an opportunity! Create an alert based on the job you applied for.