PySpark jobs in Virginia

Reston, Virginia

•

2d ago

Who we are? At Hexaware Technologies, we are a leading global IT Services company, dedicated to driving digital transformation and innovation for businesses around the world. Founded in 1990, Hexaware has grown into a global trusted partner for enterprises, offering comprehensive AI empowered services including IT Consulting, Application Development, Infrastructure and Cloud Management and Business Process services. At Hexaware we are a community of creative, diverse, and open-minded Hexawarians

Easy Apply

Full-time

$80,000 - $120,000

Python AWS Pyspark Developer

Hybrid in Reston, Virginia

•

4d ago

Must be Local to Reston, NO RELO - OnSite 3 days a week. Job Description: Location is Reston (hybrid model 3x a week in office) Strong Python developement to build a big-data pipeline for data processing and analysis Need strong experience in Hadoop EMR, Spark, Pyspark, Hive, AWS, Terraform (end to end automation), Github, CICD Need to work within a team of developers to assist with development Need to be open to collaborating and advising on best possible solutions and tools to use Nice to hav

Easy Apply

Contract

Depends on Experience

Senior Data Software Engineer with AWS, LLM, PySpark

Remote

•

Today

We are seeking a highly motivated Senior Data Software Engineer to design, build, and maintain modern cloud-based data platforms while enabling the next generation of AI and Copilot solutions. The ideal candidate will have strong expertise in AWS data ecosystems, PySpark, and experience developing AI-powered solutions using large language models and Generative AI applications. Responsibilities Design and implement scalable ETL/ELT pipelines Build and optimize data ingestion frameworks from APIs,

Full-time

Manager, Data Engineer (Python/PySpark/AWS)

Ashburn, Virginia

•

Today

*Candidates must be local to the Washington D.C. metro area. About Infinitive: Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people and personalities to our clients' culture while bringing the right mix of talent and skills to enable high return on investment. Infiniti

Full-time

USD 140,000.00 - 169,000.00 per year

Senior Consultant, Data Engineer (Python/PySpark/AWS)

Ashburn, Virginia

•

Today

Full-time

USD 90,000.00 per year

Data Platform Engineer

Remote or Toronto, Ontario

•

Today

Job Title: Data Platform Engineer Location: Remote (Canada) Employment Type: Full-Time Contract Job Summary We are seeking an experienced Data Platform Engineer to design, build, and enhance a cloud-native data platform on AWS and Snowflake. The ideal candidate will have strong expertise in data ingestion, transformation, orchestration, metadata management, and data quality, while building scalable and reliable data pipelines that support enterprise analytics and reporting. Key Responsibiliti

Easy Apply

Contract, Third Party

Azure Data Architect

Remote

•

4d ago

Sr. Data Architect- Remote- US, Canada, LATAM location are all ok We are seeking a highly skilled and experienced Sr Data Architect to join our team. As a Sr Data Architect, you will be responsible for designing, implementing, and managing data architecture on cloud platforms for our clients. Your expertise will play a critical role for our clients in shaping data strategy, ensuring efficient data integration, storage, and accessibility while maintaining data security and compliance. Key Respons

Easy Apply

Full-time

$180,000 - $190,000

Palantir Forward Deployed Engineer

Remote

•

2d ago

JOB DETAILS: Job Title: Palantir Forward Deployed Engineer Location: 100% Remote Contract Duration: 06 plus months contract with extensions (long -term contract) Job Description: Key Responsibilities Technical Leadership & Architecture Design, build, and deploy end-to-end data integration pipelines using Palantir Foundry, including complex transforms, incremental pipelines, and multi-source data connectorsArchitect and maintain the Ontology layer defining object types, link types, action typ

Easy Apply

Contract

$90 - $114

System Development Engineer

Remote

•

5d ago

Position: System Development EngineerLocation: RemoteThe common nature of the work:Every one is a System Development Engineer (Contractor) position, Seattle-based, L5L6 equivalent, 1 opening each, sitting on the Region Flexibility Migration (RFM) team inside the clients Intelligent Cloud Hosting (ICON) organization. They all serve a single 2026 initiative: DRAM (memory) footprint reduction across the clients production service fleet essentially cost/efficiency and performance engineering, not n

Easy Apply

Contract

Depends on Experience

Databricks Engineer (W2 only)

Remote

•

2d ago

Role: Databricks Engineer Duration: 6+ months contract Location:100% Remote Position details Required Skills: Proficiency in PySpark and SQL, experience with Medallion architecture, and performance tuning within the Databricks Lakehouse platform. Set up row/column-level security and manage data lineage and sharing in Unity Catalog. Utilize CI/CD and testing processes like Databricks. Utilize CI/CD and testing processes like Databricks. Preferred Skills: SAS, SQL, Unix, Linux Education: Bachel

Easy Apply

Contract

Depends on Experience

Senior Fabric ETL Developer

Remote

•

23d ago

Title: Senior Fabric ETL Developer Location: Remote Contract SUMMARY:Our client would like us to provide them with a Senior Developer with extensive experience in Microsoft Fabric, specializing in Lakehouse-based data processing and Fabric Notebooks utilizing PySpark. This role focuses on transforming curated Lakehouse data into standardized and custom text file extracts (e.g., CSV, TXT, pipe-delimited) for secure delivery to external vendors and partners. Additionally, the Developer will part

Easy Apply

Contract, Third Party

Depends on Experience

PEGA Data Science & Analytics

Merrifield, Virginia

•

16d ago

Title: PEGA Data Science & Analytics Location: Vienna, VA (HYBRID) Duration: 6-month contract with possible extensions Work Requirements: , Holders or Authorized to Work in the U.S. PEGA Data Science & Analytics To enable and simplify analysis required for faster implementation of new CDH modeling features.Looking for a candidate with 5-10 years of experience + Master''s degree and 1-2 years of strong data science and coding experience. Prioritized Deliverables: 1. Library of required queries

Easy Apply

Contract

Depends on Experience

Databricks developer

Remote

•

2d ago

Required Skills 10+ years of experience with Databricks. Strong experience in PySpark, Spark SQL, and Python. Hands-on experience with Delta Lake and Databricks Workflows. Strong SQL and data modeling skills. Experience with Azure Databricks or AWS Databricks. Knowledge of Azure Data Factory (ADF), ADLS Gen2, or AWS S3. Experience with Git, Azure DevOps, or Jenkins. Understanding of data warehousing concepts and ETL best practices. Preferred Skills Experience with Unity Catalog, MLflow, and Delt

Easy Apply

Contract

50+

Lead Microsoft Fabric Architect & Administrator

Remote

•

11d ago

Job Title: Lead Microsoft Fabric Architect & Administrator Work Location: 100% Remote Long Term Contract If you find this opportunity suitable, kindly share your updated resume. Also, please let me know a good time to connect with you for a quick discussion. Looking forward to hearing from you! Job Description We are seeking a visionary Microsoft Fabric Architect & Administrator to lead our transition into a unified, AI-ready data ecosystem. In this role, you will be the primary owner of our Mi

Easy Apply

Full-time

Depends on Experience

Lead Data Engineer (Azure, Snowflake, DB) !!! Remote

Remote

•

4d ago

Role: Lead Data Engineer (Azure, Snowflake, DB) Location: Remote Duration: Long Term Skill Focus Azure , Snowflake, DB, ETL, Python, Pyspark, SnowSQL Key Responsibilities: Design and develop ETL/ELT pipelines using Azure Data Factory, Snowflake, and DBT. Build and maintain data integration workflows from various data sources to Snowflake. Write efficient and optimized SQL queries for data extraction and transformation. Work with stakeholders to understand business requirements and translate t

Easy Apply

Contract

Depends on Experience

Multiple Databricks Positions

Remote

•

4d ago

Location: Nationwide United States Employment Type: W2 Only C2C: Not Available Job Description CodeForce 360 is hiring Databricks professionals for multiple positions with our Fortune 1000, system integrator, and enterprise clients across the United States. Opportunities may be available onsite, hybrid, or remote, depending on client requirements. We are seeking candidates with knowledge or experience across various Databricks technologies, modules, and cloud environments. Posit

Easy Apply

Full-time, Third Party

$50 - $150

Data Analytics Technical Lead with Power BI

Remote

•

23d ago

Holds Databricks Certified Data Engineer Professional certification along with strong expertise across modern analytics ecosystems and cloud-native data platforms. Data Analytics Technical Lead with extensive hands-on experience in Databricks, including advanced data engineering, lakehouse architecture, and performance optimization, supported by relevant Databricks certifications. Proven expertise leading enterprise-scale analytics initiatives across modern cloud and big data platforms. Well-rou

Easy Apply

Full-time

Depends on Experience

Senior Databricks Solution Architect

Remote

•

6d ago

Senior Databricks Solution Architect 100% RemoteLong Term Contract Overview: We are seeking an experienced and dedicated Senior Solutions Architect to lead technical engagements and provide strategic guidance for our strategic client accounts. This high-impact role requires deep expertise in the Databricks Platform, acting as the client's primary technical advisor for complex data, analytics, and AI initiatives. You will bridge business objectives with technical execution, designing and deliver

Easy Apply

Third Party, Contract

$70 - $80

Senior Forward Deployed Engineer (Palantir Foundry Delta)

Remote

•

2d ago

Senior Forward Deployed Engineer (Palantir Foundry Delta) Location: Remote (U.S.) Job Type: 12-month Contract (Potential Extensions) Openings: 2 Applicants must be authorized to work in the U.S. without current or future employer sponsorship. Important Requirement Candidates must have hands-on, real project experience with Palantir Foundry. Profiles without genuine Palantir experience will not be considered. About the Role We are hiring a Senior Forward Deployed Engineer (Delta) to act as a

Easy Apply

Contract

Depends on Experience

Data Engineer with Palantir Experience

Remote

•

2d ago

1+ years hands-on in Foundry, focused on a supply chain use case. 7+ in enterprise data engineering. Proficient in Pipeline Builder, Ontology, OSDK & Code Repo. Includes knowledge in Python, Pyspark, SQL. Has some full stack capability with React. Master''s in computer science.Palantir Foundry Aware Professional certification.RegardsRohit

Easy Apply

Contract

60,000 - 70,000

PySpark jobs in Virginia, USA