We are looking for an experienced Data Integration Engineer to support a data integration initiative that brings data from multiple enterprise systems into a centralized data platform.
The ideal candidate will have strong experience integrating NetSuite APIs, Databricks, and other enterprise data sources, with a solid understanding of ETL/ELT pipelines, data transformation, data quality, and cloud-based data platforms.
This person will work closely with business stakeholders, application teams, data engineers, and architects to design and implement reliable, scalable data integrations.
Key Responsibilities
· Design, develop, and maintain data integration pipelines between NetSuite APIs, Databricks, databases, SaaS applications, and other enterprise systems.
· Develop robust ETL/ELT processes for extracting, transforming, and loading data into the centralized data platform.
· Integrate data using REST APIs, SOAP APIs, web services, and third-party connectors.
· Work with NetSuite data and integrations, including SuiteTalk, REST/SOAP web services, saved searches, and NetSuite data structures.
· Build and optimize data pipelines using Databricks, including Spark, SQL, notebooks, and Delta Lake where applicable.
· Develop data transformations using SQL and Python/PySpark.
· Implement incremental data loads, CDC/change tracking, error handling, retry mechanisms, and data reconciliation.
· Monitor data pipelines and troubleshoot integration, performance, and data-quality issues.
· Work with large and complex datasets while ensuring scalability and reliability.
· Collaborate with data architects to establish appropriate data models, integration patterns, and data-flow architectures.
· Implement data validation and quality checks to ensure accuracy and consistency across source and target systems.
· Document APIs, data mappings, transformation logic, integration workflows, and operational procedures.
· Participate in technical discussions with business and application teams to understand data requirements and integration dependencies.
Required Qualifications
· 5+ years of experience in data engineering, data integration, ETL/ELT, or a related discipline.
· Strong hands-on experience with Databricks and modern data engineering practices.
· Strong SQL skills.
· Strong experience with Python and/or PySpark.
· Hands-on experience developing integrations using REST APIs and/or SOAP APIs.
· Experience working with NetSuite APIs, preferably with SuiteTalk, REST Web Services, SOAP Web Services, or NetSuite integrations.
· Experience building production-grade data pipelines and integration workflows.
· Strong understanding of relational databases, data modeling, and data warehousing concepts.
· Experience with cloud data platforms and modern data architecture.
· Understanding of data quality, reconciliation, error handling, logging, and pipeline monitoring.
- Strong communication skills and ability to work with both technical and non-technical stakeholders.
Preferred Qualifications
· Experience with Delta Lake, Apache Spark, Databricks Workflows, Unity Catalog, or similar Databricks capabilities.
· Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
· Experience with integration/orchestration tools such as Azure Data Factory, AWS Glue, MuleSoft, Boomi, Informatica, or similar technologies.
· Experience integrating other ERP, CRM, financial, or SaaS platforms.
· Experience with CI/CD, Git, automated testing, and DevOps practices.
· Understanding of data governance, security, access controls, and compliance.
· Experience working in Agile/Scrum environments.
Regards,
Raj Dakshinapu | Recruiter, Dotcom Team LLC
Phone:
Web: | Email:
2023 Best Places to Work – Boston Business Journal
Minority Certified – Boston Business Journal’s Top Ten 2022, 2023
Certified National Minority Supplier – NMSDC
Never miss an opportunity! Create an alert based on the job you applied for.
