Security Data Engineer

Description

We are looking for a Security Data Engineer to join our team in Costa Mesa, California in a contract capacity with the potential for a permanent role. This position is focused on advancing a well-established data lake environment by strengthening the ingestion layer, expanding connectivity to additional systems, and ensuring reliable movement of security-relevant data. The person in this role will take ownership of pipeline operations, partner with internal system stakeholders to enable access, and help keep incoming data accurate, timely, and usable for downstream needs.

Responsibilities:
Take ownership of the data ingestion layer for an existing data lake, ensuring steady performance and dependable delivery of incoming datasets.
Reduce a defined backlog of pipeline work during the first 90 days by building and activating prioritized ingestion workflows.
Assume responsibility for pipeline components transitioned from the lead engineer and continue their operational support without disrupting established foundations.
Support and improve current ETL processes by monitoring health, resolving failures, and extending coverage where needed.
Integrate new source systems, including platforms such as Rippling and Workday, into the broader data ecosystem.
Coordinate with internal application and system owners to identify data sources, secure appropriate access, and obtain logs or source records required for ingestion.
Apply data cleaning and analysis practices to improve data quality and maintain consistency across inbound datasets.
Contribute to infrastructure and deployment workflows using AWS, AWS CDK, Infrastructure as Code, and CI/CD practices to support scalable pipeline operations.

Requirements

Experience building and supporting data pipelines in a data lake or large-scale data engineering environment.
Strong programming skills in Python and hands-on experience with Apache Spark, Apache Hadoop, Apache Kafka, and ETL development.
Practical knowledge of Amazon Web Services (AWS) and infrastructure automation tools such as AWS CDK and Infrastructure as Code frameworks.
Experience maintaining pipeline reliability, troubleshooting ingestion issues, and improving operational stability in production environments.
Ability to work directly with internal stakeholders to locate source data, obtain access, and move integrations forward.
Familiarity with data analysis and data cleaning techniques that improve downstream usability and trust in datasets.
Exposure to CI/CD practices and deployment automation for data engineering workflows.
Additional programming experience in Rust or Go is preferred.

Technology Doesn't Change the World, People Do.

Robert Half is the world's first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.

Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app and get 1-tap apply, notifications of AI-matched jobs, and much more.

All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information.

2025 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking "Apply Now," you're agreeing to Robert Half's Terms of Use and Privacy Notice.