bigdata engineer Jobs in san francisco, ca

Refine Results
1 - 20 of 269 Jobs

Senior Software Engineer, Big Data

Pinterest, Inc.

•

San Francisco, California, USA

Full-time

About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It's where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you'll be challenged to take on work that upholds this mission and pushes Pinterest forward. You'll grow as a person and leader in your field, all the while helping Pinners make their lives better in the
Posted 14 days ago | Updated 4 hours ago

Big Data Engineer

ADDSOURCE

•

Remote

Third Party

Role: Bigdata Developer Exp Required: 12+Years Location: Remote Mandatory Skills: Spark, Scala EMR and AWS Job Description Bachelor's degree preferably Computer Science, Engineering, or other quantitative fields 6+ years of related experience in designing and implementing enterprise applications using big data 5+ years of experience in a senior level engineering role mentoring other engineers, which includes engineering best practices, unblocking, code reviews, unit testing, managing deployme
Easy Apply
Posted 24 days ago | Updated 12 hours ago

AWS Glue Big data engineer

System Soft Technologies

•

Remote

Contract

System Soft Technologies is widely recognized for its professionalism, strong corporate morals, customer satisfaction, and effective business practices. We provide a full spectrum of business and IT services and solutions, including custom application development, enterprise solutions, systems integration, mobility solutions, and business information management. System Soft Technologies combines business domain knowledge with industry-specific practices and methodologies to offer unique solution
Easy Apply
Posted 1 day ago

Bigdata Hadoop Engineer

Softsol Resources Inc

•

Remote or California City, California, USA

Contract

Please send me your resume to if you are interested and can be able to work on W2. Need local to California Job Title: Hadoop Engineer- CR243 Location: Remote but looking local to California. Duration : Long Term Job Description: MUST Have SKILLS. Strong project experience in Big Data, Cloudera Distribution 7.x, Cloud migration, RDBMS is must. Strong project experience with Amazon EMR/Databricks/Cloudera CDP is must. 4-5 experience building data pipelines using Hadoop components Sqoop, Hive, S
Easy Apply
Posted 15 days ago | Updated 8 days ago

Data Engineer

CGT Staffing

•

Remote

Full-time

No C2c Candidates Essential Duties & Responsibilities Analyze and organize raw data sets to meet both functional and non-functional requirementsDevelop and maintain data setsImprove data quality and efficiencyCreate scalable, production-ready pipelines for data movement and transformationWork with various stakeholders, including data, design, product, and executive teams, to assist with data-related technical issuesImplement and enhance support tools for monitoring and acting on data pipeline i
Easy Apply
Posted 30 days ago | Updated 2 days ago

Lead Data Engineer (Security Focus)

Iceberg

•

Remote

Full-time

My client is a leading innovator in financial technology and trading, dedicated to pushing the boundaries of technology to create impactful solutions. We are currently seeking a talented Lead Data Engineer with a strong background in software engineering and experience in data engineering, particularly in the realm of security. As the Lead Data Engineer with a focus on security, you will play a pivotal role in leading the development and optimization of data pipelines, tools, and products to enh
Easy Apply
Posted 27 days ago

Hiring Big data and Artificial Intelligence AI/ML Engineers for the long-term DOD program

Comtech LLC

•

Remote

Contract

We have an urgent Multiple needs of Big data/ AI/ ML/Cybersecurity/Cloud Devops & Data Scientist Engineers for the long-term DOD program we are supporting. These positions are Remote. Candidates with prior or current Clearance (Secret, Top Secret, Public Trust) will be preferred. Title: Big data and Artificial Intelligence Consultant We also have other multiple roles for ML Machine learning / Cybersecurity/ Cloud Devops & Data Scientists too Location: Remote ** Must be able to clear a DoD cleara
Easy Apply
Posted 13 days ago | Updated 13 hours ago

AWS DevOps Engineer

Xoriant Corporation

•

Remote

Contract

AWS DevOps Engineer Location: Washington DC (This is a remote position, and the candidate should be available to work in the Eastern Standard Time (EST) time zone.) Duration: Long Term Key Responsibilities: Implement scalable, resilient, and secure solutions in the public cloud, especially in AWS.Min 6 years of experience providing DevOps support to Cloud deployed Applications.Should have min 6 to 7 years of experience in AWS Cloud Orchestration , Terraform scripting, AWS Production networking
Easy Apply
Posted 7 days ago | Updated 7 days ago

Big Data Engineer - (Remote / Only for W2)

Primus Software Corp

•

Remote

Contract

Job Title: Big Data Platform Development Engineer Duration: 6 - 7+ months Contract Possibility of extension Locations: Remote - Texas *Only W2 Candidates* Discription: You will evolve the data cloud platform and building pipelines that are scalable, robust and resilient, to validate, ingest, normalize/enrich and support business rule processing of data. You will provide leadership in big data and cloud technologies. 5+ years of experience with Big Data pipelines with Spark in Java, Scala, Pyth
Easy Apply
Posted 60+ days ago | Updated 7 days ago

Software Engineer In Test

Agile

•

Remote

Full-time

Title: SDET Compensation: $160k - $190k Benefits: Medical, Dental, Vision, 401k, Disability, and more Location: 100% Remote Our client does amazing work leading innovation in the medical industry, and they're looking for an SDET to lead that innovation. This is a salary role, and it's 100% remote. The ideal candidate will have: 4+ years of software engineering experience, using software testing tools, ML frameworks, containerization, CI/CD, and AWS.Experience automating component and integration
Easy Apply
Posted 24 days ago

Senior Scala Software Engineer

JBC powered by Workgenius

•

Remote

Contract

Senior Software Engineer (Java / Scala) with Top Mass Media & Entertainment Company Senior Software Engineer (Java / Scala) Location: Remote Rate: up to $88.00/HR W2 Duration: 18 months Summary: The Ad Intelligence team is under Ad Platforms and its mission is to transform advertising and the Ad platform with data and AI across TV and streaming video. We build solutions to measure and optimize every aspect of the advertising life cycle. Our tenant is a strong cross-domain team to deliver E2E sol
Easy Apply
Posted 28 days ago | Updated 2 days ago

Sr Data Engineer

The Connors Group, Inc.

•

Remote

Full-time

The Senior Engineer is responsible for the design, development, implementation and support of ELT processes for Data Platform. Works as part of a team to develop data pipelines, data transformation logic in ADF, python or Scala and other technologies to move data from a variety of operational platforms into Azure cloud. Conduct performance tuning of ELT processes for large and medium volumes of data, develop and oversee monitoring systems to ensure data loads complete on schedule and data is acc
Easy Apply
Posted 2 days ago

Data Pipeline Engineer- Scala, Spark, AWS - Major Entertainment Company

TechLink Resources

•

Remote

Contract

Looking for a Software / Data Engineer strong with Scala, Spark, AWS, and object oriented programming. This team is under the Ads Platform team and you will be responsible of a large - scale data platform for real - time and batch processing. Must have skills: Spark, Scala, Spring/Springboot/Scala3-5 years general experience in addition to having experience in production- having worked at a company in prod environments- Operationalize and productionize of systems having worked on bothAd targetin
Easy Apply
Posted 60+ days ago | Updated 1 day ago

Data Engineer

BayOne Solutions

•

San Bruno, California, USA

Contract

Job Title: Data Engineer Location: San Bruno, CA (Hybrid) Duration: 6+ months with possible ext. Description: Designs, develops, and implements Hadoop eco-system based applications to support business requirements.Follows approved life cycle methodologies, creates design documents, and performs program coding and testing.Resolves technical issues through debugging, research, and investigation. Experience/Skills Required: Bachelor s degree in Computer Science, Information Technology, or related
Easy Apply
Posted 60+ days ago | Updated 1 day ago

DAS RF SME Engineer || hybrid -2 days onsite per week || San Francisco, California

Stellent IT LLC

•

San Francisco, California, USA

Contract, Third Party

DAS RF SME Engineer || hybrid -2 days onsite per week San Francisco, California Phone + video Long term contract Job Dscription: Skills required: Experienced with working with SQL, BI tools, Tableau. Experienced working with big data tables, Snowflake etc The responsibilities will also include to generates physical attributes for approved New Site Builds including Sites, Transmitters, and Cells using ATOLL, while integrating Best Server Coverage predictions for both existing and future plan
Easy Apply
Posted 13 days ago | Updated moments ago

Data Engineer II

The Connors Group, Inc.

•

Remote

Full-time

The Data Engineer II plays a critical role in engineering of data solutions that support the reporting and analytic needs. As a key member of the Data engineering team, will work on diverse data technologies such as Steramsets, dbt, data ops and others to build insightful, scalable, and robust data pipelines that feed our various analytics platforms. ESSENTIAL FUNCTIONS: Design and Model data engineering pipelines that support company reporting and analytic needs. Engineer efficient, adaptable,
Easy Apply
Posted 3 days ago | Updated 2 days ago

Rust Developer

Jobot

•

San Francisco, California, USA

Full-time

Remote + Great Benefits + Equity + Unlimited PTO This Jobot Job is hosted by: Ryan Kilroy Are you a fit? Easy Apply now by clicking the "Apply Now" button and sending us your resume. Salary: $200,000 - $250,000 per year A bit about us: We are trailblazing the future of data by championing decentralized data solutions. We're passionate about turning the concept of data mesh into a tangible reality. Our cutting-edge platform is purpose-built to address the challenge of decentralized data on a l
Posted 2 days ago | Updated 4 hours ago

Machine Learning Engineer

Perplexity AI

•

San Francisco, California, USA

Full-time

Perplexity is building the next generation answer engine, empowering our users to find information in new and more effective ways. Perplexity applies LLMs for knowledge search at scale, serving millions of users across the world. In pursuit of this mission, we are looking for engineers to build recommendation systems for a more engaging, easier to use product. You will be part of a dynamic team dedicated to pushing the boundaries of what's possible with machine learning, particularly in the real
Posted 50 days ago | Updated 4 hours ago

Data Scientist

SGS Consulting

•

Menlo Park, California, USA

Contract

SUMMARY: The main function of the Data Scientist is to produce innovative solutions driven by exploratory data analysis from complex and high-dimensional datasets. Job Responsibilities: Apply knowledge of statistics, machine learning, programming, data modeling, simulation, and advanced mathematics to recognize patterns, identify opportunities, pose business questions, and make valuable discoveries leading to prototype development and product improvement. Use a flexible, analytical approach to d
Easy Apply
Posted 28 days ago | Updated 12 hours ago

Data Engineering Technical Program Manager

GSPANN Technologies

•

Fremont, California, USA

Contract

About GSPANN We work in an exploding market of retail and e-commerce. We have served as a trusted business partner for some of the world s most respected brands. We ve worked with more than 200 organizations and have served as a trusted business partner for some of the world s most respected brands. Our solutions have the businesses create custom-designed technology platforms, which have transformed the way our clients connect with their employees, partners, and customers. GSPANN is headquartere
Easy Apply
Posted 2 days ago | Updated 12 hours ago