Apply Now

Senior Bigdata Engineer

Austin, TX, US • Posted 8 hours ago • Updated 8 hours ago

Contract W2

Contract Corp To Corp

12 Months

No Travel Required

On-site

Depends on Experience

Galaxy i Technologies, Inc.

Fitment

Dice Job Match Score™

⏳ Almost there, hang tight...

Job Details

Skills

Spark
pyspark
Scala

Summary

Position: Senior Data Engineer
Location: Sunnyvale, CA and Austin, TX

Key Responsibilities

Distributed Pipeline Engineering: Design, build, and maintain high-throughput, low-latency ETL/ELT pipelines using Apache Spark, PySpark, and Scala.
API & Service Development: Architect and deploy robust RESTful APIs and backend services using Python (Django / FastAPI) to expose data models and analytical engine capabilities.
Modern Data Warehousing: Model, optimize, and query high-volume datasets in cloud and OLAP data platforms such as Snowflake and Apache Doris.
Database Management: Write high-performance SQL queries, perform data modeling, and manage relational database systems (with a strong emphasis on PostgreSQL).
AI & LLM Integration: Integrate generative AI tools, LLM pipelines, and vector capabilities into existing data workflows.
Code Excellence: Write clean, modular, tested, and maintainable production code following software engineering best practices (CI/CD, version control, documentation).

Core Qualifications

Data Processing & Big Data: Proven hands-on experience building distributed data processing systems with Big Data Spark, PySpark, and Scala.
Python Development: Strong expertise in core Python development and software engineering fundamentals.
Backend Frameworks: Hands-on experience developing backend applications or services using Django or equivalent modern Python frameworks (e.g., FastAPI, Flask).
API Architecture: Proven track record of designing, building, and maintaining robust RESTful APIs.
Data Warehousing & Databases:
Advanced SQL proficiency and strong relational database management skills (PostgreSQL preferred).
Direct operational experience with cloud data platforms like Snowflake or analytical OLAP engines like Apache Doris.
Software Excellence: Strong commitment to clean code, production readiness, efficient data structures, and maintainable system design.

Nice-to-Have

AI & LLM Ecosystem: Experience with AI development tools, frameworks (LangChain, LlamaIndex), or integrating LLMs/embeddings into data pipelines.
Streaming & Event Systems: Knowledge of streaming technologies (e.g., Apache Kafka, Spark Streaming).
Cloud & DevOps: Familiarity with AWS/Google Cloud Platform/Azure, containerization (Docker, Kubernetes), and CI/CD tools.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10374872
Position Id: 35840-43206-1785947304
Posted 8 hours ago

Company Info

About Galaxy i Technologies, Inc.

Galaxy i Technologies, Inc is a global consulting and IT services company that is known for its commitment to client satisfaction. Galaxy i Technologies is an information technology firm offering IT Consulting, Staff Augmentation, Software Development & Training and E-commerce Development. We help our Clients to implement these solutions through a variety of skilled consulting services like Application management, Implementation and Infrastructure management.

Galaxy i Technologies has a pool of highly skilled professionals who work through the life cycle of challenging and exciting projects, including System Analysis, Designing, Development, Implementation, Maintenance, Enhancements and Test Support to our Fortune 500 Corporations.

Careers

Go to company profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Quantexa Technical Lead

Hybrid in East Hartford, Connecticut

•

Yesterday

Quantexa Technical Lead Contract Hartford, CT Job Description: Role Descriptions: Strong experience with Linux| Java/Scala ecosystem| Spark| Elasticsearch/OpenSearch| Kafka| SQL| scripting (Shell/Python)| CI/CD pipelines| and monitoring tools is highly desirable. Essential Skills: Quantexa Technical Lead Skills: Digital : Scala~Unix Shell Scripting and text processing tools~Unix / Linux Basics and Commands Experience Required: 10 & Above Top 3 Required Skills: Quantexa

Contract, Third Party

Depends on Experience

Search all similar jobs

More jobs at Galaxy i Technologies, Inc. in Austin, TX