apache spark Jobs

Refine Results
1,741 - 1,760 of 2,001 Jobs

Data Engineering

Tavant

Seattle, Washington, USA

Contract

Hello, Role: Software or Data engineering Location: Seattle, WA (Only local) (4 Days a week onsite 1 Day Remote) Basic Qualifications 5+ years of software or data engineering experienceFamiliarity with data pipelines and orchestration frameworks (Spark, Hadoop, Databricks, Airflow)Demonstrated expertise in modeling data to support business needs at scaleStrong programming skills in Java, Scala or PythonKnowledge of data warehouse solutions, including Databricks and Snowflake, with the ability to

QA/QC Data Validation Consultant_Remote

Libsys, Inc.

Remote

Contract

Responsibilities Data Validation: Analyze and validate data for accuracy, completeness, and consistency.Quality Assurance: Develop and implement data quality standards and processes.Issue Resolution: Identify and resolve data quality issues, ensuring compliance with regulations.Collaboration: Work with IT and data management teams to design and implement data strategies.Reporting: Generate data reports and presentations for management. Skill Strong experience in data validation and data quality

Python Developer with Pyspark, AWS and Java

FutureTech Consultants LLC

Pasadena, California, USA

Contract

Hi, Hope you are doing good, this is Rajeev from FutureTech Consultants, LLC and I have a job opening with our direct client. Please have a look at the below job description and let me know your interest. Please share me the latest copy of your resume. Role: Python Developer with Pyspark, AWS and Java Location: Pasadena, CA (ONSITE) Duration: Long Term Contract Interview Mode: F2F Job Summary: We are seeking a highly skilled Python Developer with strong PySpark expertise and hands-on experienc

Senior Data Engineer (AI/ML, Cloud) - Full Time - Bay Area, CA

Right Skale, Inc.

Pleasanton, California, USA

Full-time

Senior Data Engineer (AI/ML, Cloud) - Full Time - Bay Area, CA We are seeking a Senior Data Engineer to design and implement AI/ML-driven data solutions for enterprise cloud environments. You'll leverage modern data engineering, data warehousing, and data lake technologies on platforms like AWS, Azure, and Google Cloud Platform to optimize multi-cloud data workflows in a fast-paced, innovative setting. Responsibilities Design and develop data pipelines, data lakes, and data warehouses using cl

data engineer with ML

Impetus IT

Remote or Seattle, Washington, USA

Full-time

We are partnering with one of our staffing partners who is searching for a Data engineer with Machine learning experience to design, develop, and optimize scalable data pipelines and infrastructure for ML-driven applications. The ideal candidate will have experience in big data technologies, ETL processes, and model deployment to support advanced analytics and AI initiatives.Salary $50k-70k slight flexibility for a good candidate.Due to low rates only direct applicants no c2c candidates please.

Need AI/ML Engineer in Arlington, Texas (Day 1 Onsite) for Fulltime

BURGEON IT SERVICES LLC

Arlington, Texas, USA

Full-time

Job Title: AI/ML Engineer Location: Arlington, Texas (Day 1 Onsite) Type: Full-Time (FTE) Job Summary: We re looking for an experienced AI/ML Engineer to design, develop, and deploy machine learning models and AI solutions. This is a full-time onsite role in Arlington, TX. Key Responsibilities: Build and deploy AI/ML models to solve real-world problems Analyze and preprocess large datasets Monitor and optimize model performance Collaborate with cross-functional teams Document models and processe

Data Architect with DataBricks in GA - Onsite

TrustMinds, Inc.

Atlanta, Georgia, USA

Contract, Third Party

Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.Certified Databricks Data Engineer Professional and accredited Platform ArchitectMin.14+ years of experience in data architecture, data engineering, or a related role.Extensive experience with Azure data engineering services (e.g., ADF, ADLS, Synapse, Integration services etc)Strong knowledge of data modeling, data warehousing, and ETL processes.Proficiency in SQL and experience with programming languag

AI/ML Engineer with 12+ years (day 1 onsite)

M3BI, LLC.

Phoenix, Arizona, USA

Third Party, Contract

Overall experience of at least 12+ years is needed Design and implement scalable MLOps supportive data pipelines for data ingestion, processing, and storage. Experience deploying models with MLOps tools such as Vertex Pipelines, Kubeflow, or similar platforms. Experience implementing and supporting end-to-end Machine Learning workflows and patterns. Expert level programming skills in Python and experience with Data Science and ML packages and frameworks. Proficiency with containerization techno

Data Engineer

Application Management Services LLC

New York, New York, USA

Full-time

8+ years of experience in data engineering, with a focus on large-scale and high-throughput systems Deep experience working with time series data and purpose-built storage systems (e.g., KDB+, TimeSet, Kronos) Strong experience building streaming and batch data pipelines using tools like Glue, Kafka, Flink, or Spark Proficiency in Python and integrating data pipelines with machine learning workflows and libraries (e.g., pandas, NumPy, scikit-learn, PyTorch) Experience designing efficient, scalab

Senior Data Engineer

BayOne Solutions

Bentonville, Arkansas, USA

Third Party, Contract

Job Title: Senior Data Engineer Location: Bentonville, AR(Hybrid) Duration: 6+ Months Payrate: $65 to $70/hr. on C2C Must have: Python, SQL, Machine Learning Key Responsibilities: Design, develop, and maintain data pipelines using Spark, PySpark, and other big data technologies to process large datasets.Build and optimize complex SQL queries for data extraction, transformation, and loading (ETL) in both batch and real-time workflows.Work with cloud platforms such as AWS, Azure, or Google Cloud P

Python Developer with Java (W2 Role)

Zentek Infosoft Inc

Houston, Texas, USA

Contract

Python Developer with Java (W2 Role) Location: Houston, TX Visa - , GC Job Description: Required Qualifications, capabilities, and skills Proven Senior Developer with expertise in Oracle, Spark SQL, Javaa, Python/Shell scripting Strong experience with AWS services and cloud-based architectures Hands on practical experience in system design, application development, testing and operational stability Experience in developing, debugging and maintaining code in a large corporate environment with on

Python Developer

Trident Consulting Inc.

Bentonville, Arkansas, USA

Contract, Third Party

Trident Consulting is seeking a "Senior Python Developer " for one of our client in Bentonville, AR. A global leader in business and technology services. Job Title: Senior Python Developer Location: Bentonville, AR (Day 1 Onsite) Job Type: Contract Job Summary: The Sr. Developer will play a pivotal role in analyzing and interpreting complex data sets to drive strategic business decisions. With a focus on leveraging Google Cloud Platform Workflows, SQL, Python, Spark, and Scala, the candidate w

Software Developer - .NET

Idexcel Inc.

Montvale, New Jersey, USA

Contract

Job Title: Software Developer - .NET Location: Montvale, NJ (Hybrid) Duration: 12+ MonthsJob Responsibilities:Coding, testing, and debugging programs according to computer engineering specifications.Modifying, expanding, and updating applications.Collaborating with analysts, engineers, and quality assurance testers to coordinate and document application development and testing.Developing software prototypes.Acting with integrity, professionalism, and personal responsibility to uphold the firm s

Python Developer with Java - Berkeley Heights, NJ (Onsite) - 12+ Months contract

Lorven Technologies, Inc.

Berkeley Heights, New Jersey, USA

Full-time, Contract

Job Title: Python Developer with Java Location: Berkeley Heights, NJ (Onsite) Duration: 12+ Months Contract Required Qualifications Proven Senior Developer with expertise in Oracle, Spark SQL, Java, Python/Shell scripting. Strong experience with AWS services and cloud-based architectures. Hands on practical experience in system design, application development, testing and operational stability. Experience in developing, debugging and maintaining code in a large corporate environment with o

Data Scientist with Procurement [Only VA candidates]

I-Link Solutions

Richmond, Virginia, USA

Contract, Third Party

Data Scientist 4 Location: Richmond VA - Onsite Skills Specific to this Position: - Provide expertise to agency on data-driven decision making and strategy. - Provide expertise in specific areas, such as machine learning, predictive analytics using data and systems related to public procurement. - Leading research projects, for advanced date mining, developing algorithms, or building data pipelines related to public procurement. Tools and Technologies: - Programming languages: SQL, Python, PyS

Data Engineer

Aaditus

Columbus, Ohio, USA

Contract

Role: Data Engineer Location: Columbus, OH ( 5 days onsite) Look for nearby Candidates (Only w2) Experience : 5 + years Part of the PAM (Privileged access management) group They are looking for basically a data engineer Must be strong in the ETL/Database space Pentaho is preferred, but open to Spark/Databricks/etc Should be good with Python scripting (pandas, numpys, etc) Must be strong in SQL Data modeling experience is a big plus Needs a very good understanding of data management Cloud is a

Cloud/Big Data Engineer

Strategic Staffing Solutions

Charlotte, North Carolina, USA

Contract

Cloud/Big Data Engineer 24 months - W2 Rate - $83-85/hr Charlotte NC 3 days in office/2 days remote 4+ years of Big Data or Cloud Data Engineering experience4+ years of hands-on experience in Hadoop, Teradata and Mongo DB4+ years of experience with AWS or Google Cloud Platform4+ years of experience with GitHub4+ years of experience designing, coding, testing, debugging, and documenting for projects and programs3+ years of experience with Python & Unix/Shell scripting, Scala, Spark, HBase, Oozie

Senior Data Engineer

Akrivis Solutions

Mexico City, Mexico City, Mexico

Contract

Hello All, (were currently considering Mexico, Argentina, and other South or Latin American locations, but are open to your suggestions).THE ROLE Lead activities that include data modeling (relational and dimensional), data lake & data warehouse development, data integration / ETL process development, OLAP semantic tier development, and support.Continuously deliver and improve prioritized enterprise data assets to support global analytics, reporting, and visualization solutions.Coordinate freque

Azure Databricks Platform Administrator @ Birmingham, AL / Raleigh, NC / Maryville, TN / Memphis, TN / Dallas, TX

MRoads

Dallas, Texas, USA

Full-time

Hi, We are currently hiring for a role that I believe aligns well with your experience, and I would love to connect with you to share more details. Job Title: Azure Databricks Platform Administrator Location: Birmingham, AL / Raleigh, NC / Maryville, TN / Memphis, TN / Dallas, TX Full Time position Onsite position Experience and Education: 9 years of relevant experience required.Experience with Azure Databricks preferred.Bachelor s degree in related field required (combination of education and

SR BI Engineer/ Architect

Norwin Technologies

Issaquah, Washington, USA

Full-time

Only s Job Title : Data Engineer Duration : Full Time/Permanent Location : Issaquah, WA Hybrid (onsite 3 days per week) Required: Experience engineering and operationalizing data pipelines with large and complex datasets. Hands-on experience with Informatica PowerCenter and/or IICS. Experience with Cribl, Confluent/Kafka, Big Panda. Experience working with Cloud technologies such as ADLS, Azure Databricks, Spark, Azure Synapse, Cosmos DB and other big data technologies. Extensive experience wo