Systems Management Group, Inc
Systems Management Group, Inc

Data Engineer (Migration, DataLake, AWS) - Dallas Onsite - 10+ yrs

Dallas, TX, US • Posted 6 hours ago • Updated 6 hours ago
Contract Independent
Contract Corp To Corp
Contract W2
On-site
Depends on Experience
Company Branding Image
Fitment

Dice Job Match Score™

🔗 Matching skills to job...

Job Details

Skills

  • Data Engineer
  • Migration
  • DataLake
  • AWS
  • Spark
  • Kafka
  • Hadoop
  • Java
  • Python

Summary

Role: Data Engineer
Location: Dallas, TX (5 days Onsite)
Exp: 10+ Yrs
Top Skills: DataLake, AWS, Migration, Spark, Python/Java, Hadoop, Kafka
Engineer will be part of the datastore-migration Factory team that will be responsible to perform for the end-to-end datastore migration from on-prem DataLake to AWS hosted LakeHouse.
Responsibilities of the Engineer include:
1. Pipeline Migration:
  1. Logic & Scheduling: Refactoring and migrating extraction logic and job scheduling from legacy
    frameworks to the new Lakehouse environment.
  2. Data Transfer: Executing the physical migration of underlying datasets while ensuring data integrity.
  3. Stakeholder Engagement: Acting as a technical liaison to internal clients, facilitating "hand-off and
    sign-off" conversations with data owners to ensure migrated assets meet business requirements.
2. Consumption Pattern Migration:
  1. Code Conversion: Translating and optimizing legacy SQL and Spark-based consumption patterns (raw
    and modeled) for compatibility with Snowflake and Iceberg.
  2. Usage analysis: Understand usage patterns to deliver the required data products.
  3. Stakeholder Engagement: Acting as a technical liaison to internal clients, facilitating "hand-off and
    sign-off" conversations with data owners to ensure migrated assets meet business requirements.
  4. Data Reconciliation & Quality
3. A rigorous approach to data validation is required. Candidates must work with reconciliation frameworks
to build confidence that migrated data is functionally equivalent to that already used within production
flows.
Basic Qualifications:
  1. Education: Bachelor s or Masters in Computer Science, Applied Mathematics, Engineering, or a related quantitative field.
  2. Experience: Minimum of 3-5 years of professional "hands-on-keyboard" coding experience in a collaborative, team-based environment. Ability to trouble shoot (SQL) and basic scripting experience.
  3. Languages: Professional proficiency in Python or Java.
  4. Methodology: Deep familiarity with the full Software Development Life Cycle (SDLC) and CI/CD best practices & K8s deployment experience

Technical Stack Requirements: Kafka, ANSI SQL, FTP, Apache Spark, JSON, Avro, Parquet, Hadoop (HDFS/Hive), Snowflake, Apache Iceberg, Sybase IQ

Regards,

Prakash

732-9 3 4-4169

prakash.v(@)smg(-)llc(.)us

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91171941
  • Position Id: 8945087
  • Posted 6 hours ago

Company Info

About Systems Management Group, Inc

Systems Management Group, Inc. (SMG) was created in 1989 and is dedicated to providing a complete suite of products and services to the Healthcare Community.  In addition to selling and supporting Practice Management & EHR software, we have many add-on products to enhance practice productivity.  Our clients include medical practices, clinics and billing services from coast-to-coast.  

 

SMG's team of specialists works with CGM products including Lytec Practice Management and Lytec MD EHR. SMG was one of Lytec's first resellers and continues 35 years later to be amongst its most respected sources of experience and knowledge.  We participate on the Lytec Advisory Board and have helped bring critical features and functions to the Lytec software product for many years. 

​

SMG has worked with thousands of medical practices and is dedicated to the art of customer support.  Utilizing online remote support tools, we are a phone call away from answering your questions & resolving your issue.   ​Our experienced professional team is schooled and certified in the latest technology and industry requirements.  

Go to company profile
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Data Engineer (10+ years) w/ Pipeline Migration & Pattern Migration

Dallas, Texas

•

Today

Easy Apply

Third Party, Contract

Depends on Experience

Actimize Backend Developer (AIS, ActimizeWatch) - Dallas Onsite - 10+ yrs

Dallas, Texas

•

Today

Easy Apply

Third Party, Contract

Depends on Experience

Search all similar jobs