Senior Software Engineer - 10 Yrs - New York, NY (Onsite)

Job Description : 

Design, build, and maintain scalable data pipelines to support efficient data ingestion, transformation, and storage (ETL/ELT). Leverage advanced SQL, Python, and PySpark to analyze, curate, and validate large-scale datasets, ensuring accuracy and high data quality. Implement and optimize modern data architectures—such as the Medallion Architecture—within cloud platforms like Azure Databricks and Data Lake Storage.

Collaborate with business stakeholders to translate complex requirements into robust technical data solutions. Develop clear, actionable dashboards and visualizations using BI tools such as Power BI or Tableau. Support CI/CD processes for automated data deployment while adhering to data governance, security, and compliance standards.

Data Engineering & Pipelines

• ETL/ELT pipeline design, development, and maintenance
• Scalable data ingestion and transformation
• Data curation and validation

Programming & Data Processing

• Advanced SQL
• Python
• PySpark