Data Engineer (Data Asset Mgmt)

Overview

On Site
Contract - W2

Skills

google cloud platform
Meta-data management
Data modeling
Use cases
Knowledge transfer
Data engineering
Asset management
Data processing
Extract
transform
load
Problem solving
Customer service
Training and development
Data
SaaS
Inventory
Dashboard
Metrics
Documentation
Workflow
Analytics
Adobe
Scripting
SQL
Python
Orchestration
Databricks
Analytical skill
Communication
Cloud computing
Microsoft Azure
Amazon Web Services
MEAN stack
SAP BASIS
Policies

Job Details

Software Guidance & Assistance, Inc., (SGA), is searching for a Data Engineer for a Contract assignment with one of our premier SaaS clients in Austin, TX. The Manager is also open to 100% Remote!

Responsibilities :
  • Data Asset Inventory and Assessment
    • Inventory of existing data assets; tables, dashboards, and pipelines
    • Follow requirements to pull required data to measure the current state of these assets, set up usage metrics for internal and external stakeholders.
  • Table Metadata
    • to improve documentation coverage for tables, including table descriptions, column definitions, and data lineage.
    • Implement a centralized metadata management system to maintain and access asset documentation.
    • Ensure that all existing and new data assets are properly documented according to established standards.
  • Pipeline Clean-up and Consolidation
    • Consolidate and streamline pipelines by eliminating redundancies and unnecessary elements according to the set of provided rules.
    • Clean up and restructure data tables, ensuring consistent naming conventions, data types, and schema definitions.
    • Retire or archive obsolete dashboards and workflows.
    • Implement monitoring and alerting mechanisms for critical workflows to ensure timely issue detection and resolution.
  • Set up a foundation for scalable Data Model for the Stock Business - Implement and build performant data models to solve common analytics use-cases for Adobe Stock.
  • Knowledge Transfer and Documentation
  • Thoroughly document the work performed, including methodologies, decisions, and any scripts or tools developed.
  • Provide comprehensive knowledge transfer to the data team, ensuring a smooth transition and the ability to maintain the optimized data environment.


Required Skills :
  • 4-7 years of experience
  • Proven experience in data engineering and data asset management.
  • Proficiency in SQL, Python, and other relevant data processing languages and tools.
  • Expertise in data modeling, ETL processes, and workflow orchestration (e.g., Airflow, Databricks).
  • Strong analytical and problem-solving skills.
  • Excellent communication and documentation abilities.
  • Familiarity with cloud data platforms (e.g., Azure, AWS, Google Cloud Platform) is a plus.


SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission: to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let's work better together, we mean it. You'll join a diverse team built on these core values: customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at .

SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company to request an accommodation or assistance regarding our policy.