hadoop data engineer Jobs in fort mill, sc

Refine Results
21 - 40 of 1,301 Jobs

Intermediate Data Engineer

Kforce Technology Staffing

•

Remote or Altamonte Springs, Florida, USA

Contract

RESPONSIBILITIES: Kforce has a client that is looking for an Intermediate Data Engineer to work alongside and partner with the Big Data and Data Warehouse team in Altamonte Springs, FL. Summary: The Intermediate Data Engineer will fine tune SQL queries by reviving indexes, performing incremental loads, etc. In this role, you will also be comparing, analyzing, and developing statical analytics solutions and problems within different platforms (Python, R, etc.), and BI Platforms too (Qlik, Power
Posted 3 days ago | Updated 19 hours ago

Data Engineer

Randstad Digital

•

Remote or Minneapolis, Minnesota, USA

Full-time

job summary: Job Description: We are seeking a highly skilled and motivated Data Engineer to own our organizations data impact and architecture. This individual will play a pivotal role in designing, implementing, and maintaining robust data management systems and processes. Leveraging your expertise in data architecture, integration, and governance, you will collaborate cross-functionally to ensure the integrity, accessibility, and efficiency of our organization's data assets. location: Minnea
Posted 10 days ago | Updated 1 hour ago

Mongo DB Consultant

Denken Solutions

•

Charlotte, North Carolina, USA

Full-time, Part-time, Contract, Third Party

Title: Mongo DB Consultant Location: Charlotte, NC (Day 1 Onsite) Duration: 6+ Months JD: Experience Required: Minimum of 2+ years of hands-on experience with MongoDB Total of 7 years of professional experience in software development Skills Required: Strong proficiency in MongoDB, with a deep understanding of its query language and scalability principles Proficiency in reporting tools and data analytics methodologies Preferably experienced in the Hadoop ecosystem Proficient in JavaScri
Easy Apply
Posted 6 days ago | Updated 2 hours ago

Data Engineer

Team-Soft, LLC

•

Remote

Contract

Job Title: ELT Data Engineer Location: 100% Remote Duration: 3+ Month s possibility of extension Description: Our customer is looking for several data engineers to mine a petabyte or more of historical data from a large Controlled Unclassified Information (CUI) repository located within an Azure Governmental Controlled facility.The right candidate must have a Tier 2/MBI adjudicated background clearance.If you have other government security clearance granted with in the last 12 months but not a
Easy Apply
Posted 5 days ago | Updated 5 days ago

Azure Data Engineer (Snowflake experience)

Spar Information Systems

•

Remote

Full-time, Part-time, Contract, Third Party

Hello Everyone, Hope you are doing good My name is Pavan and I work with SPAR Information System., I have a great opportunity for you, please find the job details below, if you are interested in applying please send me your updated resume and best time for you to discuss about this opportunity in details. Role: Azure Data Engineer/Data Architect Location: Frisco, Texas or Atlanta, GA Hybrid Duration: Long term contract Expert Level Snow Flake, Azure Data Bricks, Data Modelling , Client is look
Easy Apply
Posted 2 days ago | Updated 14 hours ago

Senior Data Engineer

Refulgent Technologies Inc.

•

Remote

Contract

Senior Data Engineer REMOTE Lead end to end design and development of the data solutions.Provide guidance, mentorship, and technical expertise to the team members on the spark compute-based data engineering projects.Develop data pipelines to ingest and transform data using Scala and SQL on Spark.Setup orchestration of the pipelines using Azure Synapse pipeline.Source and version control code/configuration artifacts using GitHub.Create GitHub actions to deploy code/configuration artifacts.Create
Easy Apply
Posted 2 days ago

Cyber Data Engineer

Prudent Technologies and Consulting

•

Remote

Contract

Job Description Gather requirements from data source owners to identify data feeds, device/network locations and connectivity requirements, data feed segregation and source/destination Ips for network firewall ticket if necessary.Identify if access for operational teams will be needed for post onboarding to perform connectivity test between ingestion platform and devices.Onboard Data Sets into Cribl Development Environment and create Processing Pipeline for devices.Complete first pass QA of Crib
Easy Apply
Posted 6 days ago | Updated 2 days ago

Data Engineer

Sharp Decisions

•

Charlotte, North Carolina, USA

Contract

Data Engineer - 4 Openings Candidate can also work in Jersey City if not located in NC. Role Objectives These roles will be involved in the active development of the data platform in close coordination with the client team, beginning with the establishment of a reference data system for securities and pricing data, and later moving to other data domains.The consulting team will need to follow internal developments standards to contribute to the overall agenda of the Data Strategy team.The implem
Easy Apply
Posted 6 days ago

Data Engineer

Strategic Systems Inc

•

Remote

Contract

Job Title: Data EngineerDuration: 12 months+ POSITION SUMMARY: This contractor will be responsible for development in our Modern Data Architecture environment. Key skills are AWS, dbt, Snowflake and Denodo. PROJECT INFORMATION: Republic Services is re-platforming our Accounts Receivable from an AS400 system to Oracle Cloud. PRINCIPAL RESPONSIBILITIES: Developing data pipelines from AWS S3 to Snowflake using dbt.Creating Denodo views over Snowflake tables MINIMUM QUALIFICATIONS: Snowflake & db
Easy Apply
Posted 5 days ago | Updated 2 days ago

Data and Integration Engineer

Randstad Digital

•

Remote or West Des Moines, Iowa, USA

Full-time

job summary: Description Key Functions of the Role: Certifications (acquired or actively pursuing) Salesforce Administrator (understand the platform, configuration, security, and user management). Git/GitHub Certification - demonstrating ability to manage version control in releases and source code management. Salesforce Certified DevOps Engineer Helpful Certifications: These do not all have to be already obtained, but the expectation would be that the person in the role is working towards them
Posted 13 days ago | Updated 4 hours ago

Data Engineer

Synechron Inc.

•

Charlotte, North Carolina, USA

Full-time

We are At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development in
Posted 43 days ago | Updated 11 days ago

Data & Integration Release Engineer

Beacon Hill Staffing Group

•

Remote

Full-time

Job Title: Data & Integration Release Engineer Salary Range: $120,000 - $130,000 Job Location: This position can be 100% remote. Hiring Manager Notes: I do not expect the ideal candidate to possess all this, but I do expect that many of the items in required certifications and Critical to Role Success are checked. Having a proven experience as a release manager, coordinator, or engineer role is what I am looking for. Key Functions of the Role: Certifications (acquired or actively pursuing)
Easy Apply
Posted 18 days ago | Updated 2 hours ago

Senior Data Engineer (Machine Learning)

W3Global

•

Remote or Jersey City, New Jersey, USA

Full-time

Senior Data Engineer (ML/ ETL) Full Time Remote Responsibilities: bold">Collaborate with machine learning practitioners to understand algorithm feature and data requirements bold">Work with Engineering teams to collect required data from internal and external systems bold">Develop and maintain production-grade batch and streaming pipelines bold">Setup orchestration and automation of ETL jobs using tools such as Airflow and Jenkins bold">Improve and extend existing data infrastructure servi
Posted 4 days ago | Updated 22 hours ago

Independent Visa -Remote-Principal Data Engineer with Azure--CH

Empower Professionals

•

Remote

Contract

Title: Principal Data Engineer (14998-1) Location:- Bellevue WA- Remote Duration: 12+ Month Independent Visa LinkedIn profile should be match with the resume along with education details. Must have: We are looking for 8 years in Data Engineer Not the total years of exp . Data Engineer : 8-10 yearsAzure : 6 years- data factory, Synapse, AzureDevops, Data bricks, data modelling.ADF : 6 yearsDatabricks : 6 yearsSpark (PySpark, Spark SQL): 6 years Job descriptions Azure experience ADF for orchest
Easy Apply
Posted 11 days ago | Updated 2 days ago

Azure Data Engineer

Syeta Inc

•

Remote

Contract

Required skills : Required 10+yrs of exp candidates. Data Pipeline Design and Implementation: 1. Create robust data pipelines using Azure Data Factory to ingest, transform, and move data across various sources and destinations. 2. Optimize data workflows, ensuring scalability, reliability, and performance. Data Storage Solutions: 1. Design and maintain data storage solutions, including: Azure SQL Database: Develop and optimize database schemas, tables, and indexes. Azure Data Lake: Organize and
Easy Apply
Posted 4 days ago | Updated 3 days ago

Data Engineer

DPP Tech, Inc.

•

Remote or Vancouver, British Columbia, Canada

Contract

We are looking for a software engineer with experience in data engineering. This is a fully remote long term contract role. Requirements: Strong hands-on development experience on PysparkTotal professional experience of 8+ yearsStrong experience with AirflowsStrong experience with PythonExperience with Data Engineering, Azure DatabricksNice to haves: Experience with RedshiftExperience with AWSBachelors/Master Degree in related field About Us: DPP Tech DPP Tech is a technology consulting and staf
Easy Apply
Posted 5 days ago | Updated 5 days ago

Lead Data Engineer- Remote 12 Month Contract

Oscar Technology

•

Remote

Contract

Lead Data Engineer Remote 12-month contract $90-$95p/h Requirements: Master or Bachelor's Degree in Engineering/Computer related discipline, or equivalent experience required 10+ years of ETL / ELT Design, development and implementation experience using standard ETL/ ELT tool 10+ years of SQL Development Experience 7+ years of experience defining and managing ETL / ELT using tools and industry standard practices. 5+ years of Cloud (Azure) experience 5+ years of Snowflake experience 5+ years of
Easy Apply
Posted 26 days ago | Updated 2 hours ago

Data Engineer

Kforce Technology Staffing

•

Remote or Blue Ash, Ohio, USA

Contract, Third Party

RESPONSIBILITIES: Kforce has a client in Blue Ash, OH that is seeking a Data Engineer. Summary: We develop strategies and solutions to ingest, store, and distribute our big data. Our developers use Big Data technologies including (but not limited to) Hadoop, Pyspark, Hive, JSON, and SQL to develop products, tools and software features. REQUIREMENTS: * Bachelor's degree (Computer Science, Management Information Systems, Mathematics, Business Analytics, or STEM) * 4+ years of professional Data D
Posted 3 days ago | Updated 19 hours ago

AWS Data Engineer with financial client experience - F2F interview is must

Wissen Infotech

•

Charlotte, North Carolina, USA

Contract, Third Party

Client is looking for AWS Data Engineer with financial client experience F2F interview is must
Easy Apply
Posted 19 days ago