Hybrid Senior Data Engineer - SAP BTP Integration - W2 only - No c2C

Overview

On Site
Full Time

Skills

SAP ECC
SAP ERP
Storage
Workflow
High Availability
RESTful
Microsoft Exchange
Real-time
Authentication
OAuth
Scripting
Data Analysis
Data Profiling
Business Rules
Reporting
Meta-data Management
Regulatory Compliance
Data Security
Extract
Transform
Load
Pentaho
Microsoft
ADF
API
SQL
Stored Procedures
Query Optimization
Performance Tuning
DevOps
GitHub
Data Governance
Data Quality
Amazon Web Services
Google Cloud Platform
Google Cloud
Data Integration
Problem Solving
Conflict Resolution
SAP HANA
Cloud Computing
Python
PySpark
Data Processing
Continuous Integration
Continuous Delivery
Computer Science
Data Engineering
Microsoft Azure
SAP
Enterprise Resource Planning

Job Details

Sr. Data Engineer

Location: White Plains, NY
Work Setup: Hybrid (7.5 hour work day with 0.5 hour unpaid lunch)
LOCAL CANDIDATES ONLY
Company Overview

Our client is modernizing its Enterprise Resource Planning (ERP) system, transitioning from a decade-old SAP ECC 6.0 to a new integrated platform that will enhance efficiency across all business functions. As our Sr. Data Engineer, you will play a crucial role in designing and implementing the data infrastructure that powers this transformation.
Sr. Data Engineer Responsibilities

The Sr. Data Engineer will be responsible for:
  • Cloud Data Engineering & Integration
    • Design and implement data pipelines across AWS, Azure, and Google Cloud platforms
    • Develop SAP BTP integrations with cloud and on-premise systems
    • Ensure seamless data movement and storage between cloud platforms
  • ETL & Data Pipeline Development
    • Develop and optimize ETL workflows using Pentaho and Microsoft ADF/equivalent tools
    • Design scalable data transformation, movement, and ingestion processes
    • Monitor and troubleshoot ETL jobs to ensure high availability and performance
  • API Development & Data Integration
    • Develop RESTful APIs for data exchange between SAP and other platforms
    • Implement API-based data extractions and real-time event-driven architectures
    • Work with various authentication methods (OAuth, JWT, API keys)
  • Data Analysis & SQL Development
    • Write optimized SQL queries, stored procedures, and scripts for data analysis
    • Perform data profiling, validation, and reconciliation
    • Support data transformation logic and business rules for ERP reporting
  • Data Governance & Quality
    • Work with Ataccama and Collibra to enforce data quality and governance policies
    • Implement data lineage, metadata management, and compliance tracking
    • Ensure adherence to enterprise data security standards
Sr. Data Engineer Qualifications
Required Skills
  • 7+ years of experience in Data Engineering, ETL, and SQL development
  • Hands-on experience with SAP BTP Integration Suite for SAP and non-SAP integrations
  • Strong expertise in Pentaho (PDI), Microsoft ADF, and API development
  • Proficiency in SQL (stored procedures, query optimization, performance tuning)
  • Experience with Azure DevOps, GitHub, and CI/CD for data pipelines
  • Understanding of data governance tools (Ataccama, Collibra) and data quality management
  • Experience with AWS, Azure, and Google Cloud for data integration
  • Strong problem-solving skills and ability to work independently
Preferred Qualifications
  • Experience with SAP S/4HANA and cloud-based ERP implementations
  • Familiarity with Python, PySpark for data processing and automation
  • Knowledge of event-driven architectures
  • Experience with CI/CD for data pipelines
Education & Certifications
  • Bachelor's or Master's degree in Computer Science, Data Engineering, or related field
  • Desirable certifications:
    • Azure Data Engineer Associate
    • SAP Certified Associate - Integration Developer

As a Sr. Data Engineer, you'll be at the forefront of our ERP transformation, implementing cutting-edge data solutions that drive organizational efficiency.

We look forward to reviewing your application!
#tech
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.