Position: Senior Data Engineer – Cloud & Big Data
Location: REMOTE
Duration: Long Term Contract
Experience Level: 12+ Years
Department: Data Engineering / Analytics
About the Role:
We are seeking a highly experienced and versatile Senior Data Engineer to join our data engineering team. The ideal candidate will have a strong background in cloud data platforms (Azure), big data technologies, ETL development, and data modeling. This role involves designing and implementing scalable data pipelines, optimizing data workflows, and enabling real-time analytics across enterprise systems.
Key Responsibilities:
Data Engineering / Fabric/DevOps/GitHub integration/RBAC/ Medallion Architecture / Fabric OneLake/ ADLS Gen2 Storage
Power Automate & Azure functions.
Design, develop, and maintain scalable data pipelines using Microsoft Fabric, Azure Data Factory, Databricks, and Snowflake.
Implement ETL/ELT processes for structured and unstructured data across cloud and on-prem environments.
Collaborate with cross-functional teams to gather requirements and deliver data solutions that meet business needs.
Optimize performance of data workflows and ensure data quality and integrity.
Develop real-time data processing solutions using Apache Spark, Kafka, and Azure Stream Analytics.
Manage and maintain cloud data infrastructure including Azure Synapse, ADLS.
Build and maintain dashboards and reports using Power BI, Tableau, and other BI tools.
Perform data modeling and database optimization across SQL Server, Oracle, Snowflake, and NoSQL databases.
Document data architecture and processes for internal and external stakeholders.
Required Qualifications:
Master’s or Bachelor’s degree in Computer Science, Engineering, or related field.
10+ years of experience in data engineering, with deep expertise in Azure ecosystems.
Proficiency in SQL, PL/SQL, Python, and PySpark.
Hands-on experience with ETL tools such as SSIS, and Azure Data Factory.
Strong knowledge of data warehousing, data lakes, and real-time streaming technologies.
Experience with NoSQL databases like MongoDB, DynamoDB, and Azure Cosmos DB.
Familiarity with Agile methodologies, Azure DevOps.
Excellent communication and stakeholder management skills.
Never miss an opportunity! Create an alert based on the job you applied for.
