Overview
Skills
Job Details
Senior Data Engineer
The Senior Data Engineer is responsible for designing, building, and maintaining operational and analytical capabilities within data platforms. This role includes solution design, data analysis, production rollout, and production support activities using Java Spring Batch, Python, AWS, Oracle, and Snowflake. The position focuses on maintaining and improving a large data ecosystem that supports compensation, sales, and reporting users.
<>Education and Experience</>
- Bachelor's or Master's degree in a technology-related field (e.g., Engineering, Computer Science) with 6-8 years of experience.
- 4-6 years of Java development experience using Spring frameworks; experience writing batch jobs with Spring Batch is highly desirable.
- 3+ years of experience developing applications in AWS, with emphasis on AWS Batch, S3, and IAM.
- 4+ years of experience working with SQL (ANSI SQL, Oracle, Snowflake).
- 3+ years of Python development experience.
- Experience with Unix shell scripting (bash, ksh) and scheduling/orchestration tools (Control-M).
- Strong data modeling skills with experience in 3NF and Star Schema models.
- Proven data analysis skills and ability to work in a complex data ecosystem.
- Hands-on experience with SQL query optimization and tuning for performance.
- Experience with DevOps, Continuous Integration, and Continuous Delivery (Jenkins, Terraform, CloudFormation).
- Experience in Agile methodologies (Kanban and SCRUM).
- Experience building and deploying containerized applications using Docker.
- Financial services industry experience is a plus.
- Ability to work independently or collaboratively in a fast-paced environment.
- Strong interpersonal skills for working with multiple teams across the organization.
- Experience creating solution architecture diagrams and design documents.
- Understanding of the software development process, including analysis, design, coding, testing, problem resolution, and planning.
- Strong analytical and decision-making skills for handling ambiguous situations.
- Effective interpersonal and client-handling skills with the ability to explain technical details.
- Ability to multitask, prioritize, and adapt in a constantly evolving environment.
- Skilled in presenting to various audiences, including peers and senior management.
- Ability to navigate organizational structures and work on multiple efforts simultaneously.
- Excellent conflict management and negotiation skills; commitment to continuous learning.
- High level of dedication, initiative, and professionalism in meeting deadlines.
- Ability to handle production issues with accuracy and attention to detail.
- Design robust batch and streaming programs following standards and best practices.
- Enjoy analyzing data, identifying gaps, issues, patterns, and trends, and assessing application dependencies.
<>Must Haves</>
- Strong SQL for querying and data validation.
- Oracle.
- AWS.
- ETL experience using Java Spring Batch for data transformation.
- Note: ETL work is done in Java; Python is only a nice-to-have.
<>Nice to Haves</>
- Python.
- Snowflake.
- Financial domain experience.
Beacon Hill is an equal opportunity employer and individuals with disabilities and/or protected veterans are encouraged to apply.
California residents: Qualified applications with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act.
If you would like to complete our voluntary self-identification form, please or copy and paste the following link into an open window in your browser: ;/p>
Completion of this form is voluntary and will not affect your opportunity for employment, or the terms or conditions of your employment. This form will be used for reporting purposes only and will be kept separate from all other records.
Company Profile:
Beacon Hill Technologies, a premier National Information Technology Staffing Group, provides world class technology talent across all industries utilizing a complete suite of staffing services. Beacon Hill Technologies' dedicated team of recruiting and staffing experts consistently delivers quality IT professionals to solve our customers' technical and business needs.
Beacon Hill Technologies covers a broad spectrum of IT positions, including Project Management and Business Analysis, Programming/Development, Database, Infrastructure, Quality Assurance, Production/Support and ERP roles.
Learn more about Beacon Hill and our specialty divisions, Beacon Hill Associates, Beacon Hill Financial, Beacon Hill HR, Beacon Hill Legal, Beacon Hill Life Sciences and Beacon Hill Technologies by visiting .
Benefits Information:
Beacon Hill offers a robust benefit package including, but not limited to, medical, dental, vision, and federal and state leave programs as required by applicable agency regulations to those that meet eligibility. Upon successfully being hired, details will be provided related to our benefit offerings.
We look forward to working with you.
Beacon Hill. Employing the Future