Data Solutions Engineer

Data Solutions Engineer

Remote

12+ Months

Position description - We are seeking multiple data solutions engineers for a data services/visualization platform for a large federal agency. The resource will support the design of data lakes, data warehouses, and visualization services and work with data/cloud engineers to design data pipelines to ingest, clean and transform both batch and streaming data.
Leading the design of data warehouses, data lakes and datamarts including both the logical and physical models.

Assist in soliciting and assessing requirements for the data warehouses/data lakes among data consumers/analysts, visualization specialists, programmers, and engineers.

Optimizing the design and tuning the performance of data warehouses for efficient loading and high performance for data queries.

Facilitating change control processes for the data model within the repositories including integrating with CI/CD pipelines.

Designing and implementing a metadata repository to be used for data discovery/catalog services across the enterprise.

Provide technical guidance and mentorship to other members of the technical team.

What You Need:

Data Warehousing/Data Engineer Experience (10+ years).

Data Architecting a data lake and/or data warehouse model including defining the use of standard conventions using cloud components (AWS S3, AWS Redshift, AWS Aurora Postgres).

Creating logical and physical data models for data repositories containing a number of heterogenous sources.

Creating work streams for the development team using an Agile framework; developing a roadmap Initiatives and Epics and work with a scrum master to define stories with clear acceptance criteria.

Optimizing data warehouses for high performance for varying types of use cases (high frequency loads, large loads, high frequency queries).

Implementing various archiving and partitioning approaches to optimize data ingestion, data storage costs and meet data retention requirements.

Experience designing data models for transactional applications.

Experience with data replication, high availability, and data migrations tools and techniques.

Software Development and Customer Experience (5+ years).

Preferred Skills:

Use of integrating visualization tools, such as Tableau, Qlik, Socrata, with data lakes and data warehouses).

Use of Big Data tools including Apache Spark, Databricks, Sagemaker and MLFlow.

Experience with Azure data tools including Synapse and Data Factory.

Net Core 5/6/7 Web Application development experience, particularly on Blazor and Syncfusion Blazor area.

AWS Certified Solutions Architect

Bachelor's Degree in a related area or equivalent experience.