Data Integration Engineer NetSuite API & Databricks

We are looking for an experienced Data Integration Engineer to support a data integration initiative that brings data from multiple enterprise systems into a centralized data platform.

The ideal candidate will have strong experience integrating NetSuite APIs, Databricks, and other enterprise data sources, with a solid understanding of ETL/ELT pipelines, data transformation, data quality, and cloud-based data platforms.

This person will work closely with business stakeholders, application teams, data engineers, and architects to design and implement reliable, scalable data integrations.

Key Responsibilities

·         Design, develop, and maintain data integration pipelines between NetSuite APIs, Databricks, databases, SaaS applications, and other enterprise systems.

·         Develop robust ETL/ELT processes for extracting, transforming, and loading data into the centralized data platform.

·         Integrate data using REST APIs, SOAP APIs, web services, and third-party connectors.

·         Work with NetSuite data and integrations, including SuiteTalk, REST/SOAP web services, saved searches, and NetSuite data structures.

·         Build and optimize data pipelines using Databricks, including Spark, SQL, notebooks, and Delta Lake where applicable.

·         Develop data transformations using SQL and Python/PySpark.

·         Implement incremental data loads, CDC/change tracking, error handling, retry mechanisms, and data reconciliation.

·         Monitor data pipelines and troubleshoot integration, performance, and data-quality issues.

·         Work with large and complex datasets while ensuring scalability and reliability.

·         Collaborate with data architects to establish appropriate data models, integration patterns, and data-flow architectures.

·         Implement data validation and quality checks to ensure accuracy and consistency across source and target systems.

·         Document APIs, data mappings, transformation logic, integration workflows, and operational procedures.

·         Participate in technical discussions with business and application teams to understand data requirements and integration dependencies.

Required Qualifications

·         5+ years of experience in data engineering, data integration, ETL/ELT, or a related discipline.

·         Strong hands-on experience with Databricks and modern data engineering practices.

·         Strong SQL skills.

·         Strong experience with Python and/or PySpark.

·         Hands-on experience developing integrations using REST APIs and/or SOAP APIs.

·         Experience working with NetSuite APIs, preferably with SuiteTalk, REST Web Services, SOAP Web Services, or NetSuite integrations.

·         Experience building production-grade data pipelines and integration workflows.

·         Strong understanding of relational databases, data modeling, and data warehousing concepts.

·         Experience with cloud data platforms and modern data architecture.

·         Understanding of data quality, reconciliation, error handling, logging, and pipeline monitoring.

• Strong communication skills and ability to work with both technical and non-technical stakeholders.

Preferred Qualifications

·         Experience with Delta Lake, Apache Spark, Databricks Workflows, Unity Catalog, or similar Databricks capabilities.

·         Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.

·         Experience with integration/orchestration tools such as Azure Data Factory, AWS Glue, MuleSoft, Boomi, Informatica,  or similar technologies.

·         Experience integrating other ERP, CRM, financial, or SaaS platforms.

·         Experience with CI/CD, Git, automated testing, and DevOps practices.

·         Understanding of data governance, security, access controls, and compliance.

·         Experience working in Agile/Scrum environments.

Regards,

Raj Dakshinapu | Recruiter, Dotcom Team LLC

Phone:

Web:  | Email:

2023 Best Places to Work – Boston Business Journal

Minority Certified – Boston Business Journal’s Top Ten 2022, 2023

Certified National Minority Supplier – NMSDC