spark Jobs

Refine Results
1,501 - 1,520 of 1,780 Jobs

Python Pyspark Developer

Swanktek

Wilmington, Delaware, USA

Contract

Expert proficiency in Python programming languageExpert proficiency in PySpark, including Spark SQL and other Spark APIsTesting and debugging applications with Python test framework tools like Pytest,PyUnit, etc.In-depth knowledge of Python frameworks and libraries, such as Django or FlaskExperience with AWS cloud platforms including services like S3, Databricks, and Data Lake StorageExperience with continuous integration/continuous deployment (CI/CD) pipelines and toolsExperience with data pipe

MLOps Architect (Databricks Specialist)

Amiseq Inc.

Remote

Contract

Job Description: * 12+ years in IT experience with a minimum 10+ Years of experience in data engineering, data platform, and analytics. * Projects delivered with hands-on experience in development on Databricks. * Working knowledge of any one cloud platform (AWS, Azure, or Google Cloud Platform). * Deep experience with distributed computing with Spark, including knowledge of Spark runtime internals. * Familiarity with CI/CD for production deployments. * Working knowledge of MLOps. * Current know

Hadoop Administrator - Laurel Springs, NJ

Last Word Consulting

Laurel Springs, New Jersey, USA

Full-time

Job Title: Hadoop Administrator Location: Laurel Springs, NJ Duration: Full Time role Position Responsibilities: Design a data lake model to configure the jobs. Create a Hadoop cluster from scratch with 65 nodes on premise environment. Migrate the on-prem platform to cloud environment using data lake models and deploy the job using the tool Talentd R Studio. Work on MapR platform for performance tuning of hive and spark jobs for all users. Use Hive TEZ engine to increase the performance of

Python Pyspark, Wilmington DE(5 Day's Onsite)

Conch Technologies

Wilmington, Delaware, USA

Contract

Hi Title : Python Pyspark Location : Wilmington DE (5 Day's Onsite) Duration : 12 Months Contract Experience: 10+ Years 1. Hands-on experience on pyspark and AWS. 2. Candidates from Tier-1 companies will be prefered. Expert proficiency in Python programming language Expert proficiency in PySpark, including Spark SQL and other Spark APIs Testing and debugging applications with Python test framework tools like Pytest,PyUnit, etc In-depth knowledge of Python frameworks and libraries, such as D

Triage Engineer

Stanley David and Associates

Remote or West Chester, Pennsylvania, USA

Full-time

Role :: Triage Engineer Location :: West Chester, PA Type :: Fulltime Job Description Job Title: Triage Engineer Must Have Technical/Functional Skills At least 8+ years of experience architecting and implementing complex ETL pipelines preferably with Spark toolset.At least 4+ years of experience with Java particularly within the data spaceTechnical expertise regarding data models, database design development, data mining and segmentation techniquesGood experience writing complex SQL and ETL pr

Hybrid: Hadoop Developer with Java background

Script2IT

Alpharetta, Georgia, USA

Contract, Third Party

Programming Languages: Strong proficiency in Python, Java, and SQL. Big Data Frameworks: Deep understanding of Hadoop ecosystem (HDFS, MapReduce, Hive, Spark). Cloud Data Warehousing: Expertise in Snowflake architecture, data manipulation, and query optimization. Data Engineering Concepts: Knowledge of data ingestion, transformation, data quality checks, and data security practices. Data Modeling: Ability to design efficient data models for data warehousing environments.

Databricks Engineer

SOHO Square Solutions

Remote or US

Third Party, Contract

Qualifications Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL), as well as working familiarity with a variety of database structures (MongoDB, DataVault) Experience building and optimizing data pipelines, architectures, and datasets Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement Strong analytic skills related to working wit

Python Developer (Minimum 12+ Years) : Wilmington, DE (Only Locals) : Long-Term Contract

HAN IT Staffing Inc.

Wilmington, Delaware, USA

Contract, Third Party

Hi, I'd like you to take a look at a great new position we now have available! Your opinion would be valued with regards to this opening. I really appreciate sending an updated resume & the best number with the best time to reach you. Role: Python Developer (Minimum 12+ Years) Location: Wilmington, DE (Only Locals) Duration: Long-Term Contract Job Description Expert proficiency in Python programming languageExpert proficiency in PySpark, including Spark SQL and other Spark APIsTesting and debug

AWS Data Engineer

TechniPros, LLC

Dallas, Texas, USA

Contract

Role : Azure engineer(w2 position, day 1 on-site) 3150-1 Location: Rockville MD/ Trevose Rate : 48/hr on W2 Job Description : Azure Data Lake Gen1/Gen2, Azure Data factory , Azure Data bricks, Azure DWH, Azure Synapse, Key vault, Azure Active directory. Data brick services (like processing streaming data using Spark clusters), usage of Blob containers, ESB, Event Grid, Azure SQL server, Cosmos DB, Azure functions, Analytics (like Power BI) is a mandatory requirement. Comments s: Scala, SQ

Contract Only-Azure Databricks Lead with Pyspark Python

Corporate Biz Solutions Inc

Branchville, New Jersey, USA

Third Party, Contract

Azure Databricks Lead with Pyspark PythonBranchville, NJ onsiteContractPrimary Technologies Azure Databricks spark pythonDatabase Technologies SQL MS SQL Server Relational DatabasesAdherence to Testing Best Practices Methodologies Unit EndToEnd EtcAdherence to Application Development Documentation Best PracticesExperience in conducting Design Code ReviewsWe are an Equal Opportunity Employer. Thanks! Tara

Google Cloud Platform Data Engineer

Ztek Consulting

Richardson, Texas, USA

Contract, Third Party

Hi, I would like to share an excellent opening Contact Google Cloud Platform Data Engineer do go through the details and kindly send me the updated resume. Location : Richardson TX (Hybrid) Type of Hire : Contract Mode of interview : WebEx / Teams Job Description : Google Cloud Platform - Data Proc, Kubernetes Engine, Cloud Storage, BigQuery, PUB/SUB, Cloud Functions and Dataflow. Cloud Composer, ETL experience - working with large data sets, PySpark, Python, Spark SQL, DataFrames, PyTest Tha

PYTHON PYSPARK W2

Zentek Infosoft Inc

Wilmington, Delaware, USA

Contract

Location :: Wilmington, DEJob Description : Python Pyspark Expert proficiency in Python programming language Expert proficiency in PySpark, including Spark SQL and other Spark APIs Testing and debugging applications with Python test framework tools like Pytest,PyUnit, etc. In-depth knowledge of Python frameworks and libraries, such as Django or Flask Experience with AWS cloud platforms including services like S3, Databricks, and Data Lake Storage Experience with continuous integration/continuous

Python Pyspark - Wilmington, DE (ONSITE)

HPTech Inc.

Wilmington, Delaware, USA

Contract

Role: Python Pyspark Location: Wilmington, DE - ONSITE Duration: 12 Months Contract Interview Process: 2 Rounds Client: Mphasis Experience: 10+ Years Job Description: Expert proficiency in Python programming language Expert proficiency in PySpark, including Spark SQL and other Spark APIs Testing and debugging applications with Python test framework tools like Pytest,PyUnit, etc In-depth knowledge of Python frameworks and libraries, such as Django or Flask Experience with AWS cloud platforms inc

Big Data Developer

URSI Technologies Inc.

Remote

Third Party, Contract

Role : Big Data Developer (10+ exp needed) Location : Austin, Texas Duration: 12 Months Qualifications : Required SkillsShould be able to communicate effectively with business and other stakeholders bull Demonstrate ownership.Hands-on experience designing and implementing data applications in production using Java/ Python/ R and etc on big data platformExperience with related/complementary open source software platforms and languages such as Java, Linux, Apache, Open Street Map, D3.js and etcStr

Data engineering Lead with Marketing domain (Google Cloud Platform Cloud)

Urpan Technologies, Inc.

Bentonville, Arkansas, USA

Full-time

Job Description: We are looking for experienced Senior Data Engineers with a strong background in Google Cloud Platform (Google Cloud Platform) and Big Data technologies. This role requires designing, developing, and maintaining scalable data solutions while collaborating in an agile environment. Responsibilities: Build and optimize big data applications using open-source technologies. Design logical and physical data models. Automate workflows using Apache Airflow. Develop data pipelines using

AWS Data Engineer

ITBMS Inc.

Plano, Texas, USA

Third Party, Contract

BS/BA degree or equivalent experience General: Strong organizational, problem-solving, and critical thinking skills; Strong documentation skills Coding: Proficiency in Python & Java Cluster Computing frameworks: Proficiency in Spark and Spark SQL AWS Data Services: Proficiency in Lake formation, Glue ETL (or) EMR, S3, Glue Catalog, Athena, Kinesis (or) MSK, Airflow (or) Lambda + Step Functions + Event Bridge Data De/Serialization: Expertise in at least 2 of the formats: Parquet, Iceberg, AVRO, J

Full stack Engineer

Prism IT Corp

Remote

Full-time

Job Description: About the Role The Relevance Team builds machine learning models to power product experiences and item rankings across various surfaces. The Difference You Will Make Explore, shape, and develop new product experiences alongside engineers and product managers, from ideation to implementation Develop prototypes to iteratively validate ideas that push technical capabilities Integrate AI capabilities into future products Your Expertise 3+ years of frontend software development ex

Python Pyspark

Synapse Tech Services Inc

Wilmington, Delaware, USA

Third Party, Contract

Please share your updated resume to Fasi at synapsetechservice dot com Python Pyspark Wilmington DE/Columbus, OH -5 Days Onsite " Longterm C2C 1. Hands-on experience on Pyspark and AWS. 2. Candidates from Tier-1 companies will be preferred Python/Pyspark: 70% AWS: 30%" Experience: 10+ Years "JD: Expert proficiency in Python programming language Expert proficiency in PySpark, including Spark SQL and other Spark APIs Testing and debugging applications with Python test framework tools like Pytest,

Python Developer - Pyspark (Only local to DE)

InfiCare Technologies

Wilmington, Delaware, USA

Contract, Third Party

Title: Python Developer - Pyspark Location: Wilmington DE (5 Days Onsite) Duration: Long Term contract Experience: 10+ Years JD: Expert proficiency in Python programming language. Expert proficiency in PySpark, including Spark SQL and other Spark APIs. Testing and debugging applications with Python test framework tools like Pytest, PyUnit, etc. In-depth knowledge of Python frameworks and libraries, such as Django or Flask. Experience with AWS cloud platforms including services like S3,

Data Engineer

Collabera LLC

Chicago, Illinois, USA

Full-time

Job Title: Data Engineer Locations: Chicago, IL/ Addison, Tx Pay Range: $60 - $65/hr. Duration: 12-18 Months (Potential for Full-Time Conversion) Must Haves: Programming background Strong Hadoop/ Big Data experience Python, Spark, Scala, Kafka expertise On Premise Day To Day Responsbilities: Working experience on tools like Hive, Spark, HBase, Sqoop, Impala, Kafka, Flume, Oozie, MapReduce, etc. Hands on programming experience in perhaps Java, Scala, Python, or Shell Scripting, to name a few Ex