We are seeking an experienced Programmer Analyst / Data Engineer to lead the design, development, and maintenance of scalable and high-performance data solutions. The role involves supporting and modernizing a large enterprise disease surveillance and case management platform used for public health monitoring.
The ideal candidate will have extensive experience with AWS, Databricks, ETL pipelines, Python/Scala, and Elastic Stack, along with strong database design expertise and experience working on large enterprise applications.
Key Responsibilities
Lead the design and development of scalable, high-performance solutions using AWS services
Build and maintain ETL processes and data pipelines
Develop clean, maintainable, and efficient code in Python or Scala
Work with Databricks, S3, Elasticsearch, and Kibana
Implement and manage Elasticsearch for efficient data retrieval and analytics
Design logical and physical database models
Develop database objects such as stored procedures and functions
Support data warehousing, data integrity, and data visualization solutions
Participate in full SDLC activities including requirement analysis and technical documentation
Provide technical leadership and guidance to development teams
Collaborate with stakeholders to review and approve software design documents
Work in Agile development environments
Support CI/CD pipelines using Azure DevOps
Required Skills
12+ years of experience developing complex database systems
8+ years of experience with Databricks
8+ years of experience with Elasticsearch and Kibana
8+ years of experience with Python or Scala
8+ years of experience with Oracle databases
5+ years of experience building ETL processes and data pipelines
5+ years of experience with AWS Cloud development
5+ years experience with data warehousing, data visualization, and data integrity
5+ years experience using CMM/CMMI Level 3 practices
5+ years experience with Agile development and Test Driven Development
Nice to Have
Experience creating CI/CD pipelines using Azure DevOps
Experience working with Electronic Health Records (EHR) and HL7 integrations