ETL Architect with sales force exp.

ETL Architect with sales force exp.

Irvine, CA (initial remote for 2 months)

12+month of contract

Key Responsibilities :-

Architecture & Design:

• Define ETL architecture and frameworks for large-scale data processing.
• Design data pipelines for structured and unstructured data using Medallion Architecture principles (Bronze, Silver, Gold layers).
• Architect metadata-driven frameworks to enable dynamic and reusable data pipelines.
• Ensure scalability, security, and cost optimization in all cloud-based solutions.

Development & Implementation:

• Build and optimize ETL workflows using Databricks, Airflow, and Python-based frameworks.
• Implement data quality checks, error handling, and governance mechanisms.

Migration & Modernization:

• Lead migration from legacy ETL tools (Informatica, SSIS, Talend) to modern platforms such as Databricks and Snowflake.
• Ensure smooth transition with minimal downtime.

Performance Optimization:

• Tune ETL processes for high performance and scalability.
• Monitor and troubleshoot data pipeline issues proactively.

Collaboration:

• Work closely with Data Architects, DBAs, Business Analysts, and cross-functional teams.
• Provide technical guidance to ETL developers and data engineers.

Required Skills

• Strong expertise in ETL tools (Informatica, SSIS, Talend) and scripting languages (Python, SQL).
• Strong expertise in Databricks, Medallion Architecture, Apache Airflow, and AWS cloud services (S3, EC2, Lambda, Glue, etc.).
• Proven ability to design metadata-driven architectures.
• Knowledge of data modeling, data governance, and data quality frameworks.
• Strong expertise in big data technologies (Spark, Pyspark)

Thanks & Regards,

Soumya Dixit

Desk:

Email:

Nityo Infotech Corp. |

666 Plainsboro Road, Suite 1285, Plainsboro, NJ 08536