Overview
Skills
Job Details
TECHNOGEN, Inc. is a Proven Leader in providing full IT Services, Software Development and Solutions for 15 years.
TECHNOGEN is a Small & Woman Owned Minority Business with GSA Advantage Certification. We have offices in VA; MD & Offshore development centers in India. We have successfully executed 100+ projects for clients ranging from small business and non-profits to Fortune 50 companies and federal, state and local agencies.
-
We are looking for a skilled Technical Lead to oversee the design and implementation of large-scale data engineering and migration projects
-
Databricks & Delta Lake - Evaluate a good understanding of hands-on experience with Databricks, including development using PySpark or Spark SQL, Efficient use of Delta Lake for scalable data pipelines, and data lineage in Databricks
-
Azure Data Factory - Evaluate good understanding of Building and managing ETL pipelines using ADF, using ADF for orchestration with Databricks, Blob Storage, SAP sources, Monitoring, error handling, and pipeline performance tuning
-
Performance Optimization- Evaluate a good understanding of handling Performance optimization on Databricks
-
Python & PySpark - Evaluate good understanding of writing robust, maintainable data processing scripts, using Python/Spark for custom transformations and integration logic
-
SAP HANA Experience/knowledge - Integrating SAP data with other platforms, handling large-scale SAP data extraction, transformation, and migration; Good understanding of SAP HANA architecture and data modeling
-
ETL Tools, SAP Data Services - Evaluate good understanding of creating, deploying, and optimizing data jobs in SAP BODS/Data Services, working with complex mappings and SAP-specific data types, handling change data capture (CDC) scenarios
-
Data Profiling & Validation - Evaluate a good understanding of data profiling, validation, and reconciliation during migrations
-
Azure Cloud & Networking - Evaluate good understanding of Azure services related to compute, storage, networking, and security, Experience resolving firewall, VPN, and VNet issues impacting data pipelines, Familiarity with IAM, RBAC, and secure credential storage