Sr. Data Engineer

We are looking for a Sr. Data Engineer

We are seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines that support the organization's growing data infrastructure needs. This role is focused on the engineering and optimization of data pipelines and will play a key part in ensuring data flows efficiently, reliably, and securely across systems. The successful candidate will work closely with cross-functional teams to streamline data pipeline architecture and improve overall data delivery performance.

Responsibilities:

• Design, develop, and maintain robust, scalable data pipelines to support ingestion, transformation, and delivery of data across the organization
• Optimize existing data pipeline architecture for performance, reliability, and cost-efficiency
• Build and maintain ETL/ELT processes using Databricks as the primary platform
• Monitor pipeline health, troubleshoot data flow issues, and implement fixes to minimize downtime and data loss
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and translate them into scalable technical solutions
• Implement and enforce data quality, validation, and governance best practices across pipelines
• Partner with infrastructure/platform teams to ensure pipelines are secure, well-documented, and maintainable
• Identify opportunities to automate manual data processes and improve pipeline efficiency
• Support data migration and integration efforts as the organization's data ecosystem evolves
• Document pipeline architecture, data flows, and technical processes for internal knowledge sharing

Requirements:

• Bachelor's degree in Computer Science, Data Engineering, Information Systems, or a related field, or equivalent practical experience
• Demonstrated professional experience as a Data Engineer, with a strong focus on building and optimizing data pipelines

Required Skills:

• Hands-on experience with Databricks (required)
• Strong proficiency in SQL and at least one programming language commonly used in data engineering (e.g., Python, Scala)
• Solid understanding of ETL/ELT design patterns, data warehousing concepts, and pipeline orchestration
• Experience working with large-scale, distributed data processing frameworks (e.g., Apache Spark)
• Familiarity with cloud data platforms and services (e.g., AWS, Azure, or Google Cloud Platform)
• Strong problem-solving skills and the ability to troubleshoot complex data pipeline issues independently
• Excellent communication skills, with the ability to work cross-functionally with both technical and non-technical stakeholders

Preferred Skills:

• Experience with pipeline orchestration tools (e.g., Airflow, Databricks Workflows)
• Familiarity with CI/CD practices as applied to data engineering
• Experience implementing data quality monitoring or observability frameworks
• Prior experience supporting data infrastructure in a growing or scaling organization