Senior Data Engineer

Position:::: Senior Data Engineer

STAY CST / EST; NOT PST

(Remote)

Job Description :

• Communicate with business leaders to help translate requirements into functional specification
• Develop broad understanding of business logic and functionality of current systems
• Analyze and manipulate data by writing and running SQL queries
• Analyze logs to identify and prevent potential issues from occurring
• Deliver clean and functional code in accordance with business requirements
• Consume data from any source, such a flat files, streaming systems, or RESTful APIs
• Interface with Electronic Health Records
• Engineer scalable, reliable, and performant systems to manage data
• Collaborate closely with other Engineers, QA, Scrum master, Product Manager in your team as well as across the organization
• Build quality systems while expanding offerings to dependent teams
• Comfortable in multiple roles, from Design and Development to Code Deployment to and monitoring and investigating in production systems.

Requirements

• Bachelors in Computer Science or equivalent
• Proven ability to complete projects in a timely manner while clearly measuring progress
• Ability to use AI driven tooling to iterate
• Strong software engineering fundamentals (data structures, algorithms, async programming patterns, object-oriented design, parallel programming)
• Strong understanding and demonstrated experience with at least one popular programming language (.NET or Java) and SQL constructs.
• Experience writing and maintaining frontend client applications, React preferred
• Strong experience with revision control (Git)
• Experience with cloud-based systems (Azure / AWS / Google Cloud Platform).
• High level understanding of big data design (data lake, data mesh, data warehouse) and data normalization patterns
• Demonstrated experience with Queuing technologies (Kafka / SNS / RabbitMQ etc
• Demonstrated experience with Metrics, Logging, Monitoring and Alerting tools
• Strong communication skills
• Strong experience with use of RESTful APIs
• High level understanding of HL7 V2.x / FHIR based interface messages.
• High level understanding of system deployment tasks and technologies. (CI/CD Pipeline, K8s, Terraform)
• Ability to collaborate closely with product, data analytics teams, and Epic analysts
• Experience designing real-time streaming pipelines and batch workflows
• Proficiency in building scalable data pipelines on Big Data Platforms and ETL/ELT workflows
• Strong Python programming experience for data ingestion, transformation, and automation workflows

Preferred Qualifications

• 3+ years in senior or lead roles.
• Expert-level skills in writing and optimizing complex queries (preferably across multiple databases e.g., SQL Server, Snowflake, Postgres)
• Solid knowledge of Apache Kafka (Kafka Streams, Schema Registry, Avro/JSON serialization)
• Advanced experience building distributed data pipelines, ETL/ELT workflows, and real-time/streaming jobs (Spark SQL, PySpark, Spark Structured Streaming)
• Strong understanding of data modeling, data quality, and governance in regulated environments (HIPAA, HITRUST)
• Prior experience in healthcare IT, EMR/EHR systems (Epic preferred), and HL7/FHIR standards
• Experience developing data integration services or custom connectors using Java/Kotlin, particularly for EMR/clinical system
• Familiarity with Epic Interconnect APIs, Bridges, or other healthcare interoperability frameworks
• Experience with Azure (preferred), AWS, or Google Cloud Platform for data engineering workloads
• Experience working on Databricks platform.