Sr Data Integration Engineer

    • Adobe Systems
  • San Jose, CA
  • Posted 14 days ago | Updated 5 hours ago

Overview

On Site
USD 124,000.00 - 234,200.00 per year
Full Time

Skills

Attention to detail
Cross-functional team
Data integration
Integration architecture
Extract
transform
load
Data quality
Performance tuning
Parallel computing
High availability
Information design
Knowledge sharing
Emerging technologies
Computer science
Programming languages
Batch processing
Apache Kafka
Apache Flink
Apache Spark
Data modeling
Data warehouse
Problem solving
Google Cloud Platform
Big data
Pivotal
Data
FOCUS
Streaming
Collaboration
Design
Leadership
Scalability
Governance
Caching
Documentation
Research
Innovation
Python
Java
Scala
SQL
NoSQL
Database
Communication
Cloud computing
Amazon Web Services
Microsoft Azure
Docker
Kubernetes

Job Details

JOB LEVEL
P40
EMPLOYEE ROLE
Individual Contributor

The Opportunity

As a Senior Data Integration Engineer, you will play a pivotal role in our data infrastructure team. Do you enjoy designing, implementing, and maintaining robust data integration solutions? Your primary focus will be on building streaming and batch-based integration capabilities to ensure seamless flow of data across our organization's systems. You will collaborate closely with cross-functional teams including data scientists, analysts, and software engineers to support various data-driven initiatives and enhance our overall data ecosystem.

What You'll Do:
  • Design and Development: Lead the design and development efforts for streaming and batch-based data integration solutions, ensuring scalability, reliability, and efficiency.
  • Integration Architecture: Define and implement integration architectures that align with business objectives and best practices, considering factors such as data volumes, latency requirements, and security.
  • Data Pipeline Development: Build robust data pipelines to extract, transform, and load (ETL) data from diverse sources into centralized repositories, warehouses, or data lakes.
  • Streaming Technologies: Apply streaming technologies to build next generation streaming integrations.
  • Data Quality and Governance: Implement data quality checks, validation processes, and governance frameworks to ensure the accuracy, consistency, and integrity of integrated data.
  • Performance Optimization: Continuously optimize data integration processes for performance, scalability, and cost-effectiveness, demonstrating techniques such as parallel processing, caching, and partitioning.
  • Monitoring and Troubleshooting: Establish monitoring and alerting mechanisms to proactively identify and address issues in data integration pipelines, ensuring high availability and reliability.
  • Collaboration and Documentation: Collaborate with cross-functional teams to understand data requirements and provide technical expertise in data integration solutions. Document design decisions, configurations, and best practices for knowledge sharing and future reference.
  • Research and Innovation: Stay abreast of emerging technologies, trends, and best practices in data integration and streaming processing, and evaluate their applicability to enhance our data infrastructure.

What you need to succeed:
  • Bachelor's in Computer Science, Engineering, or a related field.
  • Proven experience (5-7 years) in designing, implementing, and optimizing data integration solutions, preferably in a senior or lead role.
  • Strong proficiency in programming languages such as Python, Java, or Scala.
  • Hands-on experience with streaming and batch processing frameworks such as Apache Kafka, Apache Flink, Apache Spark, or similar technologies.
  • In-depth understanding of data modeling, ETL processes, and data warehousing concepts.
  • Proficiency in SQL and familiarity with relational and NoSQL databases.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.
  • Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and containerization technologies (e.g., Docker, Kubernetes) is a plus.
  • Relevant certifications (e.g., AWS Certified Big Data - Specialty, Google Professional Data Engineer) would be advantageous.

Our compensation reflects the cost of labor across several U.S. geographic markets, and we pay differently based on those defined markets. The U.S. pay range for this positionis $124,000 -- $234,200 annually. Paywithin this range varies by work locationand may also depend on job-related knowledge, skills,and experience. Your recruiter can share more about the specific salary range for the job location during the hiring process.

At Adobe, for sales roles starting salaries are expressed as total target compensation (TTC = base + commission), and short-term incentives are in the form of sales commission plans. Non-sales roles starting salaries are expressed as base salary and short-term incentives are in the form of the Annual Incentive Plan (AIP).

In addition, certain roles may be eligible for long-term incentives in the form of a new hire equity award.

Internal Opportunities

Creativity, curiosity, and constant learning are celebrated aspects of your career growth journey. We're glad that you're pursuing a new opportunity at Adobe!

Put your best foot forward:

1. Update your Resume/CV and Workday profile - don't forget to include your uniquely 'Adobe' experiences and volunteer work.

2. Visit the Internal Mobility page on Inside Adobe to learn more about the process and set up a job alert for roles you're interested in.

3. Check out these tips to help you prep for interviews.

4. If you are applying for a role outside of your current country, ensure you review the International Resources for Relocating Employees on Inside Adobe, including the impacts to your Benefits, AIP, Equity & Payroll.

Once you apply for a role via Workday, the Talent Team will reach out to you within 2 weeks. If you move into the official interview process with the hiring team, make sure you inform your manager so they can champion your career growth.

At Adobe, you will be immersed in an exceptional work environment that is recognized around the world. You will also be surrounded by colleagues who are committed to helping each other grow through our unique Check-In approach where ongoing feedback flows freely. If you're looking to make an impact, Adobe's the place for you. Discover what our employees are saying about their career experiences on the Adobe Life blog and explore the meaningful benefits we offer.

Adobe is an equal opportunity and affirmative action employer. We welcome and encourage diversity in the workplace regardless of gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other characteristics protected by law.

If you have a disability or special need that requires accommodation to navigate our internal careers site or to complete the application process, please contact