Job Description Senior Systems Analyst – Data Engineering (Onshore, Databricks)
Location: Onsite in Richmond, VA
Role Summary We’re seeking an onshore Senior Systems Analyst (Data Engineering) to lead the productionalization of data ingestion and curation. You will design the frameworks, controls, and processes that make data movement reliable and repeatable, create clear documentation, and guide an offshore team responsible for day to day build and run. You’ll also help assess different tools for patterns for specific use cases.
What You’ll Do (Key Responsibilities)
• Design data movement frameworks: Define reusable patterns for source onboarding, change data capture (as applicable), schema evolution, error handling, and operational runbooks.
• Implement data quality & reconciliation controls: Define source to target parity checks, row/column level validations, sampling strategies, reconciliation dashboards, and exception workflows; partner with engineers to embed controls in pipelines.
• Create clear documentation: Author process docs, onboarding guides, data flow diagrams, mapping specifications, and operational SOPs to ensure consistent understanding across teams.
• Evaluate tooling choices: Recommend where Fivetran connectors make sense (e.g., rapid replication/archival) vs. when to leverage Databricks ingestion, Delta, and Catalog capabilities.
• Coordinate offshore delivery: Provide requirements, review designs, groom tasks, and ensure adherence to standards; mentor engineers and unblock execution.
• Stakeholder alignment: Work directly with product/architecture leads to confirm scope, prioritize sources, and communicate status, risks, and trade offs.
• Operational readiness: Define monitoring, alerting, SLAs, cost guardrails, and access patterns; ensure handoffs to run/ops are complete and auditable. Must Have Qualifications
• 8+ years in data engineering / data platforms with strong ETL/ELT fundamentals and data movement patterns (batch/near real time).
• Proven experience designing validation and reconciliation controls (source to target checks, DQ rules, automated reporting).
• Demonstrated ability to author high quality documentation (frameworks, standards, SOPs, mapping/specs).
• Experience leading or enabling offshore teams (backlog grooming, code/design reviews, quality gates, knowledge transfer). • Strong communication and stakeholder management; able to translate business needs into actionabletarg technical work for engineering teams. Nice to Have
• Exposure to Fivetran (connector configuration, load strategies, monitoring) — not required but helpful.
• Familiarity with Unity Catalog/Databricks Catalog, Delta Live Tables, or other Databricks-native ingestion/orchestration approaches.
• Experience with Azure data services (e.g., ADLS, ADF/Synapse triggers/pipelines) in support of Databricks.
• Insurance data domain familiarity (e.g., policy, claims, billing) and legacy source onboarding.
• SQL proficiency for profiling, validation queries, and investigative analysis. How You’ll Work
• Onsite (Richmond, VA) presence for key workshops and collaboration; hybrid/flexible otherwise.
• Partner closely with onshore stakeholders for scope & prioritization; offshore team focuses on build, test, and operate under your standards and guidance.
• Deliver repeatable blueprints and clean documentation so onboarding additional sources becomes faster and safer over time.
Must Have Qualifications
• 8+ years in data engineering / data platforms with strong ETL/ELT fundamentals and data movement patterns (batch/near real time).
• Proven experience designing validation and reconciliation controls (source to target checks, DQ rules, automated reporting).
• Demonstrated ability to author high quality documentation (frameworks, standards, SOPs, mapping/specs).
• Experience leading or enabling offshore teams (backlog grooming, code/design reviews, quality gates, knowledge transfer).
• Strong communication and stakeholder management; able to translate business needs into actionabletarg technical work for engineering teams. Nice to Have
• Exposure to Fivetran (connector configuration, load strategies, monitoring) — not required but helpful.
• Familiarity with Unity Catalog/Databricks Catalog, Delta Live Tables, or other Databricks-native ingestion/orchestration approaches.
• Experience with Azure data services (e.g., ADLS, ADF/Synapse triggers/pipelines) in support of Databricks.
• Insurance data domain familiarity (e.g., policy, claims, billing) and legacy source onboarding.
• SQL proficiency for profiling, validation queries, and investigative analysis. How You’ll Work
• Onsite (Richmond, VA) presence for key workshops and collaboration; hybrid/flexible otherwise.
• Partner closely with onshore stakeholders for scope & prioritization; offshore team focuses on build, test, and operate under your standards and guidance.
• Deliver repeatable blueprints and clean documentation so onboarding additional sources becomes faster and safer over time.
.png%3Fformat%3Dwebp&w=828&q=75)
Never miss an opportunity! Create an alert based on the job you applied for.