spark Jobs

Refine Results
1,641 - 1,660 of 1,924 Jobs

pyspark

Reveille Technologies

•

Wilmington, Delaware, USA

Contract, Third Party

Hi, Job Title: Python Pyspark Engineer - 11+ Years Exp Must Job Location: Wilmington DE :: 5 Day's Onsite Responsibilities: Hands on experience on pyspark and AWS. Expert proficiency in Python programming languageExpert proficiency in PySpark, including Spark SQL and other Spark APIsTesting and debugging applications with Python test framework tools like Pytest, PyUnit, etcIn-depth knowledge of Python frameworks and libraries, such as Django or FlaskExperience with AWS cloud platforms including
Easy Apply
Posted 2 days ago

Python Pyspark Developer

Swanktek

•

Wilmington, Delaware, USA

Contract

Expert proficiency in Python programming languageExpert proficiency in PySpark, including Spark SQL and other Spark APIsTesting and debugging applications with Python test framework tools like Pytest,PyUnit, etc.In-depth knowledge of Python frameworks and libraries, such as Django or FlaskExperience with AWS cloud platforms including services like S3, Databricks, and Data Lake StorageExperience with continuous integration/continuous deployment (CI/CD) pipelines and toolsExperience with data pipe
Easy Apply
Posted 15 days ago

MLOps Architect (Databricks Specialist)

Amiseq Inc.

•

Remote

Contract

Job Description: * 12+ years in IT experience with a minimum 10+ Years of experience in data engineering, data platform, and analytics. * Projects delivered with hands-on experience in development on Databricks. * Working knowledge of any one cloud platform (AWS, Azure, or Google Cloud Platform). * Deep experience with distributed computing with Spark, including knowledge of Spark runtime internals. * Familiarity with CI/CD for production deployments. * Working knowledge of MLOps. * Current know
Easy Apply
Posted 30 days ago | Updated 24 days ago

Contract Only -Azure, Data Bricks Senior Developer

Corporate Biz Solutions Inc

•

Branchville, New Jersey, USA

Third Party, Contract

Azure Databricks Senior Developer Branchville, New Jersey Onsite Contract Primary Technologies Azure Databricks spark python Database Technologies SQL MS SQL Server Relational Databases Adherence to Testing Best Practices Methodologies Unit EndToEnd Etc Adherence to Application Development Documentation Best Practices Experience in conducting Design Code Reviews Strong experience on ETL concepts We are an Equal Opportunity Employer. Thanks! Ronalyn
Easy Apply
Posted 10 days ago | Updated 1 day ago

Triage Engineer

Stanley David and Associates

•

Remote or West Chester, Pennsylvania, USA

Full-time

Role :: Triage Engineer Location :: West Chester, PA Type :: Fulltime Job Description Job Title: Triage Engineer Must Have Technical/Functional Skills At least 8+ years of experience architecting and implementing complex ETL pipelines preferably with Spark toolset.At least 4+ years of experience with Java particularly within the data spaceTechnical expertise regarding data models, database design development, data mining and segmentation techniquesGood experience writing complex SQL and ETL pr
Easy Apply
Posted 6 days ago

Hybrid: Hadoop Developer with Java background

Script2IT

•

Alpharetta, Georgia, USA

Contract, Third Party

Programming Languages: Strong proficiency in Python, Java, and SQL. Big Data Frameworks: Deep understanding of Hadoop ecosystem (HDFS, MapReduce, Hive, Spark). Cloud Data Warehousing: Expertise in Snowflake architecture, data manipulation, and query optimization. Data Engineering Concepts: Knowledge of data ingestion, transformation, data quality checks, and data security practices. Data Modeling: Ability to design efficient data models for data warehousing environments.
Easy Apply
Posted 9 days ago

AWS Data Engineer

TechniPros, LLC

•

Dallas, Texas, USA

Contract

Role : Azure engineer(w2 position, day 1 on-site) 3150-1 Location: Rockville MD/ Trevose Rate : 48/hr on W2 Job Description : Azure Data Lake Gen1/Gen2, Azure Data factory , Azure Data bricks, Azure DWH, Azure Synapse, Key vault, Azure Active directory. Data brick services (like processing streaming data using Spark clusters), usage of Blob containers, ESB, Event Grid, Azure SQL server, Cosmos DB, Azure functions, Analytics (like Power BI) is a mandatory requirement. Comments s: Scala, SQ
Easy Apply
Posted 2 days ago | Updated 1 day ago

Hadoop Admin with EKS- Sunnyvale, CA- Onsite

ProCorp Systems Inc.

•

Sunnyvale, California, USA

Contract, Third Party

Hello Hope you re doing well! Title: Hadoop Admin with EKS Location: Sunnyvale, CA- Onsite Site Reliability Engineer (SRE) - Cloud Infrastructure & Data- Ensure reliable, scalable, and secure cloud-based data infrastructure. Skillset: Kubernetes | AWS | Hadoop(Spark, Python) Experience: 6-9 years - Design, implement, and maintain AWS infrastructure with a focus on data products. - Automate infrastructure management using Pulumi or Terraform, and policy as code. - Knowledge on building helm relea
Easy Apply
Posted 5 hours ago

Machine Learning AI Engineer

Buxton Consulting

•

Remote

Contract

Position: Machine Learning AI Engineer Duration: 12+ Months Location: Remote Must Haves Strong project experience in Machine Learning, Big Data, NLP, Deep Learning, RDBMS is must. Strong project experience with Amazon Web Services and Cloudera Data Platform is must. 4-5 experience building data pipelines using Python, MLLib, PyTorch, TensorFlow, Numpy/Scipy/Pandas, Spark, Hive, 4-5 years of programming experience in AWS, Linux and Data Science notebooks is must. Strong experience with REST API
Easy Apply
Posted 1 hour ago

Contract Only-Azure Databricks Lead with Pyspark Python

Corporate Biz Solutions Inc

•

Branchville, New Jersey, USA

Third Party, Contract

Azure Databricks Lead with Pyspark PythonBranchville, NJ onsiteContractPrimary Technologies Azure Databricks spark pythonDatabase Technologies SQL MS SQL Server Relational DatabasesAdherence to Testing Best Practices Methodologies Unit EndToEnd EtcAdherence to Application Development Documentation Best PracticesExperience in conducting Design Code ReviewsWe are an Equal Opportunity Employer. Thanks! Tara
Easy Apply
Posted 29 days ago | Updated 17 days ago

Google Cloud Platform Data Engineer

Ztek Consulting

•

Richardson, Texas, USA

Contract, Third Party

Hi, I would like to share an excellent opening Contact Google Cloud Platform Data Engineer do go through the details and kindly send me the updated resume. Location : Richardson TX (Hybrid) Type of Hire : Contract Mode of interview : WebEx / Teams Job Description : Google Cloud Platform - Data Proc, Kubernetes Engine, Cloud Storage, BigQuery, PUB/SUB, Cloud Functions and Dataflow. Cloud Composer, ETL experience - working with large data sets, PySpark, Python, Spark SQL, DataFrames, PyTest Tha
Easy Apply
Posted 10 days ago | Updated 6 days ago

PYTHON PYSPARK W2

Zentek Infosoft Inc

•

Wilmington, Delaware, USA

Contract

Location :: Wilmington, DEJob Description : Python Pyspark Expert proficiency in Python programming language Expert proficiency in PySpark, including Spark SQL and other Spark APIs Testing and debugging applications with Python test framework tools like Pytest,PyUnit, etc. In-depth knowledge of Python frameworks and libraries, such as Django or Flask Experience with AWS cloud platforms including services like S3, Databricks, and Data Lake Storage Experience with continuous integration/continuous
Easy Apply
Posted 21 days ago

Python Pyspark - Wilmington, DE (ONSITE)

HPTech Inc.

•

Wilmington, Delaware, USA

Contract

Role: Python Pyspark Location: Wilmington, DE - ONSITE Duration: 12 Months Contract Interview Process: 2 Rounds Client: Mphasis Experience: 10+ Years Job Description: Expert proficiency in Python programming language Expert proficiency in PySpark, including Spark SQL and other Spark APIs Testing and debugging applications with Python test framework tools like Pytest,PyUnit, etc In-depth knowledge of Python frameworks and libraries, such as Django or Flask Experience with AWS cloud platforms inc
Easy Apply
Posted 17 days ago | Updated 1 day ago

Data Architect

Avance Consulting

•

Houston, Texas, USA

Full-time

Required Qualifications: At least 7 years of experience in Information Technology.Data Analysis Proficiency: Skilled in analyzing data using tools like SQL and Python. Capable of assessing communication needs and evaluating the effectiveness of communication strategiesAgile Methodologies: Familiarity with Agile practices for managing projects.ETL Process Management: Expertise in Extract, Transform, Load (ETL) processes to integrate data from various sources.Big Data Technologies: Familiarity wit
Easy Apply
Posted 2 days ago | Updated 3 hours ago

Senior Python Developer

Strategic Staffing Solutions

•

Charlotte, North Carolina, USA

Contract

Job Title: Senior Python Developer Location: Charlotte, NCDepartment: Data Engineering / AI & Machine LearningEmployment Type: Contract Job Summary: We are seeking a highly skilled Senior Python Developer with deep experience in distributed computing, machine learning, and data engineering. The ideal candidate will have a strong command of Python, hands-on expertise with Apache Spark and Airflow, and a background in building scalable APIs and microservices. Familiarity with cloud computing plat
Easy Apply
Posted 1 day ago | Updated 3 hours ago

Big Data Developer

URSI Technologies Inc.

•

Remote

Third Party, Contract

Role : Big Data Developer (10+ exp needed) Location : Austin, Texas Duration: 12 Months Qualifications : Required SkillsShould be able to communicate effectively with business and other stakeholders bull Demonstrate ownership.Hands-on experience designing and implementing data applications in production using Java/ Python/ R and etc on big data platformExperience with related/complementary open source software platforms and languages such as Java, Linux, Apache, Open Street Map, D3.js and etcStr
Easy Apply
Posted 10 days ago | Updated 9 days ago

AWS Data Engineer

ITBMS Inc.

•

Plano, Texas, USA

Third Party, Contract

BS/BA degree or equivalent experience General: Strong organizational, problem-solving, and critical thinking skills; Strong documentation skills Coding: Proficiency in Python & Java Cluster Computing frameworks: Proficiency in Spark and Spark SQL AWS Data Services: Proficiency in Lake formation, Glue ETL (or) EMR, S3, Glue Catalog, Athena, Kinesis (or) MSK, Airflow (or) Lambda + Step Functions + Event Bridge Data De/Serialization: Expertise in at least 2 of the formats: Parquet, Iceberg, AVRO, J
Easy Apply
Posted 35 days ago | Updated 16 days ago

Full stack Engineer

Prism IT Corp

•

Remote

Full-time

Job Description: About the Role The Relevance Team builds machine learning models to power product experiences and item rankings across various surfaces. The Difference You Will Make Explore, shape, and develop new product experiences alongside engineers and product managers, from ideation to implementation Develop prototypes to iteratively validate ideas that push technical capabilities Integrate AI capabilities into future products Your Expertise 3+ years of frontend software development ex
Easy Apply
Posted 28 days ago | Updated 15 days ago

AWS Data Engineer- St Louis MO (Fully Onsite)- C2C-CH

Empower Professionals

•

St. Louis, Missouri, USA

Contract, Third Party

Role: Data engineer Duration: 12 months Location: Sant. Luis MO (Fully On site) Primary Skills : Spark, Scala, Kafka, SQL Secondary Skills : Apache NiFi, Hbase/DynamoDB, AWS Glue, EMR, Amazon S3, Lambda, EC2, Athena, Aurora, RDS Job description: Total IT experience of 7+ years and must have 4+ years of relevant experience in solutioning and managing large-scale data solutions using Big Data technologies like Hadoop, Spark, Scala, Kafka and AWS Data Engineering Services. Experience in designing
Easy Apply
Posted 2 days ago | Updated 19 hours ago

Data Engineer

Collabera LLC

•

Chicago, Illinois, USA

Full-time

Job Title: Data Engineer Locations: Chicago, IL/ Addison, Tx Pay Range: $60 - $65/hr. Duration: 12-18 Months (Potential for Full-Time Conversion) Must Haves: Programming background Strong Hadoop/ Big Data experience Python, Spark, Scala, Kafka expertise On Premise Day To Day Responsbilities: Working experience on tools like Hive, Spark, HBase, Sqoop, Impala, Kafka, Flume, Oozie, MapReduce, etc. Hands on programming experience in perhaps Java, Scala, Python, or Shell Scripting, to name a few Ex
Easy Apply
Posted 23 days ago | Updated moments ago