Senior Data Engineer

Overview

On Site
Full Time

Skills

UI
Information Technology
Network
Microsoft
Tier 1
Recruiting
Training
Partnership
Communication
Security Clearance
Unstructured Data
Data Extraction
Documentation
Apache HTTP Server
Electronic Health Record (EHR)
Kubernetes
Advanced Analytics
Collaboration
Testing
Data Quality
Data Processing
Extract
Transform
Load
Cloud Computing
Data Storage
Python
SQL
Apache Spark
COTS
Open Source
Data Engineering
Elasticsearch
Apache NiFi
Agile
Artificial Intelligence

Job Details

CCS Global Tech is a rapidly growing Information Technology company with a diverse portfolio of technology products and services and a large network of industry partnerships. With over 22 years of being a successful business with a global talent pool and presence, CCS is a certified Microsoft Gold Partner and specializes in delivering expert Microsoft based solutions for technical and business needs. We have been recognized by Inc. 500 Magazine as one of the fastest growing small companies in the Unites States.
we are a Tier 1 vendor for the City and County of San Francisco for Cloud Services, Staffing Services and Training Services. For this multi-year opportunity with a diverse set of needs to address, we are currently focusing on establishing partnerships with individuals as well as companies who can help us enhance our overall service portfolio, cut lead times, and ultimately help us deliver successfully. We currently hold sizable Government accounts in the San Francisco bay area including City and County of San Francisco, San Mateo County, and Santa Clara County.
We take great pride in our global reach and local influence. Your experience alongside our highly skilled and talented internal team who guide you along the way, offers key insights into what helps you stand out in a competitive job market.
If you are a partner company, please submit resumes with contact information of your own W2 Consultants only. Submitted consultants are expected to have excellent communication skills.

Title: Sr. Data Engineer
Clearance: TS/SCI w/ FSP
Location: Herndon/Chantilly, VA
Rate: $180K $190K

Summary:
Develop new tools, code, and services to execute data engineering activities involving data of varying types and in varying conditions. Activities include the following tasks:

  • Movement of structured and unstructured data using approved methods.

  • Execute data ingestion activities for storing data in a local or enterprise-level location.

  • Develop code to format data that supports exploration.

  • Analyze source data formats and work with Data Scientists and partners to determine the formats and transforms that best meet mission objectives.

  • Develop code and tools to provide one-time and ongoing data extraction from various repositories, formatting and transformations into enterprise or standalone data models.

  • Develop new ETL and perform O&M and enhancements on existing ETL code using best practices/standards.

  • Develop and deliver documentation for each project including ETL mappings, code use guide, code location, and access instructions.

Responsibilities:

  • Design and optimize data pipelines using tools such as Spark, Apache Iceberg, Trino, OpenSearch, EMR cloud services, NiFi, and Kubernetes containers.

  • Ensure the pedigree and provenance of the data is maintained such that the access to data is protected.

  • Clean and preprocess data to enable access for advanced analytics.

  • Collaborate with enterprise working groups to advance the state of data standards.

  • Collaborate with the engineering team, data stewards, and mission partners to aid in getting actionable value out of the data holdings.

  • Collaborate with software engineers to update, configure, and maintain data services based on the requirements.

  • Ensure data quality by working with the testing and data quality team to enhance standardization of data conditioning pipelines.

  • Experience adapting to various types and formats of data, and working with development teams to integrate new data processing platforms.

Required Skills:
10+ years' experience with:

  • Data lifecycle engineering.

  • Development and maintenance of extract, transform, and load (ETL) tools and services.

  • Cloud and on-prem data storage and processing solutions.

  • Python, SQL, Spark, and other data engineering programming.

  • COTS and open-source data engineering tools such as ElasticSearch and NiFi.

  • Processing data within the Agile Lifecycle.

Preferred Skills/Experience:

  • Experience using AI/LLMs to accelerate the processing and transformation of data.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About CCS Global Tech