Join a hands-on Data Architect opportunity focused on designing and building a modern data integration platform for batch, micro-batch, and real-time data. This role is ideal for a technical builder who enjoys solving complex data challenges across cloud, on-premises, and streaming environments while shaping knowledge graph solutions that support meaningful business outcomes.
Responsibilities
- Design and build end-to-end data ingestion pipelines for batch, micro-batch, and streaming use cases.
- Develop and maintain ETL/ELT workflows using Databricks, Spark, Delta Lake, and related Azure services.
- Create knowledge graph solutions, including ontology design, entity and relationship modeling, and graph load processes.
- Work with PostgreSQL-based graph implementations or comparable graph technologies to support querying, indexing, and performance optimization.
- Integrate data from APIs, relational systems, files, SaaS platforms, event streams, and CDC sources.
- Support secure connectivity between on-premises and cloud environments using approved networking and integration patterns.
- Apply medallion architecture, data modeling standards, and reusable pipeline frameworks to improve consistency and scalability.
- Implement data quality, observability, lineage, and governance practices across the data platform.
- Contribute to CI/CD and infrastructure-as-code efforts for data engineering solutions.
- Collaborate with technical and business stakeholders to translate requirements into effective architecture and delivery plans.
- Document design decisions and provide guidance to engineering teammates through code and design reviews.
Skills
- 8-12 years of data engineering experience with a strong hands-on delivery background.
- Experience in an architect, senior technical lead, or similar role with individual contributor responsibilities.
- Proven knowledge graph experience, including schema design, entity resolution, ingestion, and querying.
- Strong Databricks experience, including Spark, Delta Lake, Unity Catalog, and Structured Streaming.
- Solid Azure data platform knowledge, including ADLS Gen2, Azure Data Factory, Event Hubs, Azure Functions, Key Vault, and Azure Database for PostgreSQL.
- Advanced Python and SQL skills.
- Strong PostgreSQL expertise, including schema design, indexing, and query tuning.
- Experience working with graph databases and query languages such as Apache AGE, openCypher, Neo4j, or similar tools.
- Experience with streaming and CDC technologies such as Kafka, Spark Structured Streaming, or Debezium.
- Understanding of data security, access control, and encryption practices.
- Clear communication skills with the ability to explain technical ideas to varied audiences.
Preferred Skills
- Familiarity with semantic web and graph standards such as RDF, OWL, or SPARQL.
- Experience with graph analytics.
- Certifications related to Databricks or Azure data engineering and architecture.
- Exposure to Airflow, Docker, or Kubernetes.
- Background working in regulated industries such as healthcare, finance, or government.
Horizontal is committed to fostering an inclusive, respectful, and collaborative workplace where diverse perspectives are valued and everyone has the opportunity to contribute and thrive. We encourage candidates from all backgrounds to apply and help build teams that reflect a wide range of experiences and ideas.
By applying for this position, you acknowledge and agree that Horizontal Talent may contact you regarding your application using automated technology, including phone calls, SMS/text messages, or email, which may be delivered by our virtual AI recruiter, Alex.
Please apply through this online posting or by visiting our Job Board at Applications will be accepted for 4 weeks. For those that join the team, we offer competitive compensation and benefits including medical, dental, vision, and retirement. Check out all we have to offer and how you can become part of the Horizontal Talent Team. The pay range for this role is $49 - $85 per hour based on qualifications and experience.
