Role :Senior Software Engineer Location : New York, NYJob Description : Design, build, and maintain scalable data pipelines to support efficient data ingestion, transformation, and storage (ETL/ELT). Leverage advanced SQL, Python, and PySpark to analyze, curate, and validate large-scale datasets, ensuring accuracy and high data quality. Implement and optimize modern data architecturessuch as the Medallion Architecturewithin cloud platforms like Azure Databricks and Data Lake Storage. Collaborate