Overview
On Site
$70,000 - $140,000
Full Time
Skills
Big Data
Python
Apache Kafka
Hadoop
Apache Hadoop
Kafka
CAssandra
Apache Cassandra
Scala
End-user Training
Functional Requirements
Management
Problem Solving
Apache Hive
Apache Spark
Collaboration
Communication
Conflict Resolution
Amazon Web Services
Process Mapping
Requirements Elicitation
SQL
Agile
Shell Scripting
Streaming
System Testing
Technical Support
Unix
Job Details
Role: Data Engineer
Work location: Austin, TX
Job Description:
Skills: Spark, Scala, Spark Streaming, Big data Hadoop, hive, Kafka, Cassandra
Key Qualifications Responsibilities:
Technical:
- Develop and implement scalable solutions using technologies like Spark, Scala, Bigdata Hadoop
- Manage system integrations, optimize data pipelines, and provide technical support.
Functional:
- Gather business requirements, design functional specifications, streamline processes, conduct system testing, and deliver user training.
- Collaborate with business stakeholders and technical teams to ensure alignment between business goals and technical solutions.
Skills & Qualifications:
Technical:
- Strong experience in Spark Scala, SQL (basic and advanced), Kafka, Cassandra, Spark Streaming
- Good to have AWS experience Should have Python and Unix shell scripting knowledge
Functional:
- Expertise in business process mapping, requirements gathering, and functional specification creation.
- Excellent communication and problem-solving skills.
- Familiarity with Agile development methodologies.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.