✨ Finding the perfect fit...
Perform for the end-to-end datastore migration from on-prem Data-Lake to AWS hosted Lake-House
Engineer will be part of the datastore-migration Factory team that will be responsible to perform for the end-to-end datastore migration from on-prem DataLake to AWS hosted LakeHouse. This is a high visibility and crucial project for the client.
Responsibilities of the Engineer includes:
Skill set one:-
Hands on programming Python, Pyspark.
Skills:- Apache Spark, Hadoop (HDFS/Hive), Sybase IQ, Shell scripting , Apache Iceberg , AWS Ecosystems for bigdata processing ( EMR, Redshift, Athena, Glue eic ), AWS Lamda expressions ,Step functions, CI/CD best practices & Kubernates deployment experience
Skill set two:-
Hands on programming JAVA, Python
Skills:- Snowflake, Kafka, SnowSQL, Apache Iceberg, Shell scripting , Apache Iceberg , AWS Ecosystems for bigdata processing ( EMR, Redshift, Athena, Glue eic ), AWS Lamda expressions ,Step functions, Data moulding experience (SCD Type 2), CI/CD best practices & Kubernates deployment experience
Never miss an opportunity! Create an alert based on the job you applied for.Dallas, Texas
•
Yesterday
Role: Data Engineer (10+ years) w/ Pipeline Migration & Pattern Migration Location: Dallas, TX (Onsite) Experience: 10+ years Job Description: Responsible to perform for the end-to-end data store migration from on-prem Data Lake to AWS hosted Lake House Professional proficiency in Python or Java. Experience in Kafka, Hadoop (HDFS/Hive), Snowflake -- Thanks & Regards, RaviKiran ravikiran(.)m@smg-llc(.)us
Easy Apply
Contract, Third Party
Depends on Experience
Dallas, Texas
•
2d ago
Role: Data Engineer Location: Dallas, TX (5 days Onsite) Exp: 10+ Yrs Top Skills: DataLake, AWS, Migration, Spark, Python/Java, Hadoop, Kafka Engineer will be part of the datastore-migration Factory team that will be responsible to perform for the end-to-end datastore migration from on-prem Data Lake to AWS hosted LakeHouse. Responsibilities of the Engineer include: Pipeline Migration:Logic & Scheduling: Refactoring and migrating extraction logic and job scheduling from legacy frameworks to th
Easy Apply
Third Party, Contract
Depends on Experience
Dallas, Texas
•
Today
Job Role: Data Engineer Experience: 10+ Location: Dallas , TX Skills: Data store Migration from on-prem , Datalake tool AWS hosted Lake house . Pipeline migration logic and Scheduling , data transfer , Translating legacy SQL and Spark for compatibility Snowflake and Iceburg , datareconciliation , Python / java , CI/CD , Kafka , FTP , Json , Avro , hadoop , sybase IQ
Easy Apply
Contract, Third Party
Depends on Experience
Dallas, Texas
•
Today
Data Engineer (AWS | Snowflake/Redshift | Python | SQL) W2 Hire Dallas, TX Job Summary We are looking for a Data Engineer to design, build, and maintain scalable batch data pipelines. The ideal candidate will have experience integrating data from multiple enterprise systems, working with cloud-based data platforms, and delivering high-quality datasets for analytics and reporting. Key Responsibilities - Design and develop end-to-end batch data pipelines (hourly schedules) -
Easy Apply
Contract, Third Party
$50 - $65
