Overview
Skills
Job Details
Job Title: SR. Data Engineer/Developer - ONLY on W2
Location: Foster City, CA (3 days onsite)
Job Type: 18 Months Contract
Job Summary:
We are seeking a highly skilled Data Engineer with deep expertise in Databricks, AWS, Advanced Python, PL/QL, Starburst, and Oracle to design, develop, and optimize data pipelines. The ideal candidate will have a strong background in big data processing, cloud infrastructure, and database management to support scalable and efficient data solutions.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark.
- Implement ETL processes for structured and unstructured data across AWS cloud environments.
- Optimize SQL and PL/QL queries for performance and reliability in Oracle databases.
- Work with Starburst to enhance data federation and query optimization across multiple sources.
- Collaborate with cross-functional teams to integrate Paytheon solutions into data workflows.
- Ensure data security, compliance, and governance across all platforms.
- Monitor and troubleshoot data pipeline performance, ensuring high availability and efficiency.
- Develop automation scripts for data ingestion, transformation, and validation.
Required Skills & Qualifications:
- 5+ years of experience in data engineering or related roles.
- Strong expertise in Databricks, Apache Spark, and big data processing.
- Proficiency in AWS services (S3, Redshift, Lambda, Glue, etc.).
- Advanced knowledge of PL/QL and Oracle database management.
- Experience with Starburst for federated query optimization.
- Familiarity with Python for data integration and workflow automation.
- Strong understanding of data modeling, ETL processes, and cloud architecture.
- Excellent problem-solving skills and ability to work in agile environments.
Preferred Qualifications:
- BS or MS in Computer Science.
- Life Siences experience is a big pl
- Certifications in AWS, Databricks, or Oracle.
- Experience with containerization (Docker, Kubernetes).
- Knowledge of CI/CD pipelines for data engineering.
The salary range provided for this contract role represents our good faith estimate for this position. Within the range, individual offers will vary based on the selected candidate's experience, industry knowledge, technical and communication skills, location and other factors that may prove relevant during the interview process (W2 or C2C). In addition to compensation, the company provides eligible W2 employees with a comprehensive and highly competitive benefits package.
I.T. Solutions, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.