DATA ENGINEER

Duties:

• Gain access to data across the organization and provide ongoing analysis of the data by monitoring, profiling, and analyzing databases.
• Requires a mix of functional, data, and technical skills.
• Understand business requirements, translate them into information needs, and implement those requirements using available data.
• Responsible for expanding and optimizing data architecture, as well as optimizing data flow and collection for cross-functional teams.
• Support software developers, database architects, data analysts, and data scientists on data initiatives and ensure optimal data delivery architecture is consistent throughout ongoing projects.

Job Responsibilities:

• Assemble large, complex data sets that meet functional/non-functional business requirements.
• Strong knowledge of SQL required. Ability to identify sets and subsets of information across multiple joins or unions of tables is preferred in addition to writing and troubleshooting SQL queries for data mining.
• Perform complex data analysis and investigation for customer requests to explain results and make appropriate recommendations.
• Strong understanding of data modeling concepts.
• Problem solver with the initiative to think critically to identify improvement opportunities (error detection, error correction, root cause analysis).
• Understand ETL that will aid in verification and testing of data.
• Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
• A successful history of manipulating, processing, and extracting value from large disconnected datasets.
• Analyze business objectives and develop data solutions to meet customer needs.
• Demonstrated ability to effectively participate in multiple, concurrent projects.
• Improve and customize current data solutions to meet business functional and non-functional requirements.
• Research new and existing data sources in order to contribute to new development, improve data management processes, and make recommendations for data quality initiatives.
• Perform periodic data quality reviews for internal and external data.
• Ensure timely resolution of queries and data issues.
• Look for new ways to find and collect data by researching potential new sources of information.
• Work with data and analytics experts to strive for greater functionality in our data systems.

Required Skills:

• 3–5 years of experience in data engineering.
• Experience building and maintaining scalable data pipelines and data platforms.
• Technical Skills:
  • Strong proficiency in SQL and Python.
  • Experience with ETL/ELT development and data ingestion and transformation frameworks.
  • Understanding of Delta Lake/modern data storage formats and Medallion architecture (Bronze/Silver/Gold layers).
• Data & Platform Expertise:
  • Strong understanding of data transformations (cleaning, shaping, aggregating, and preparing data for downstream use).
  • Data lineage (ability to track where data comes from, how it is transformed, and where it is consumed).
  • Data quality and governance concepts.
  • Experience supporting reporting and analytics (Power BI preferred).
  • Familiarity with data security and access controls (RBAC).
• Nice to Have:
  • Microsoft Fabric experience.
  • Data catalog/lineage tools (Purview or similar).
  • CI/CD (Azure DevOps, Git).
  • Basic streaming or real-time ingestion exposure.

Key Competencies:

• Strong problem-solving and data troubleshooting skills.
• Detail-oriented with focus on data accuracy and traceability.
• Ability to work across data, BI, and governance teams.