Data Engineer

Knoxville, TN, US • Posted 10 hours ago • Updated 10 hours ago
Full Time
On-site
Company Branding Image
Fitment

Dice Job Match Score™

🛠️ Calibrating flux capacitors...

Job Details

Skills

  • Data Engineering
  • Real-time
  • Data Processing
  • Storage
  • Analytics
  • Workflow
  • Scalability
  • Collaboration
  • Apache Hadoop
  • HDFS
  • Apache Kafka
  • Apache Spark
  • Streaming
  • Apache Hive
  • Apache NiFi
  • Apache Flink
  • Apache Storm
  • Apache Oozie
  • Python
  • Scala
  • Java
  • NoSQL
  • MPP
  • Apache HBase
  • MongoDB
  • Apache Cassandra
  • Amazon Redshift
  • Microsoft Azure
  • Google Cloud
  • Google Cloud Platform
  • Amazon Web Services
  • Technical Drafting
  • Conflict Resolution
  • Problem Solving
  • Informatica
  • Talend
  • Database
  • Oracle
  • MySQL
  • Microsoft SQL Server
  • PostgreSQL
  • Data Governance
  • Messaging
  • Apache ActiveMQ
  • RabbitMQ
  • Microservices
  • Performance Tuning
  • Extract
  • Transform
  • Load
  • Optimization
  • Cloud Computing
  • Big Data
  • Artificial Intelligence

Summary

Join a hybrid Data Engineer opportunity focused on building and improving modern big data solutions for ingestion, integration, and transformation. This role supports impactful data initiatives and offers flexibility to work from an East Coast office or on-site in Knoxville, TN when needed.
Responsibilities
  • Design and implement data engineering components that support client requirements and technical solution goals.
  • Build and maintain batch and real-time data ingestion, integration, and transformation workflows.
  • Work with large-scale data processing and storage technologies to support reliable, efficient data pipelines.
  • Contribute to analytics, search, and aggregation capabilities across data platforms.
  • Participate in technical design discussions and help ensure the overall health and performance of the solution.
  • Support cloud-based data platform services and optimize data workflows for performance and scalability.
  • Collaborate with project teams in a hybrid work environment and attend onsite interviews or equipment pickup when required.
Skills
  • At least 4 years of hands-on experience with big data technologies.
  • Experience with Hadoop ecosystem tools such as HDFS, Kafka, Spark, Spark Streaming, Hive, NiFi, Airflow, Flink, Storm, Oozie, or similar platforms.
  • Strong programming experience in Java, Python, or Scala, with Java preferred.
  • Working knowledge of NoSQL and MPP data platforms such as HBase, MongoDB, Cassandra, AWS Redshift, Azure SQLDW, or Google Cloud Platform BigQuery.
  • Experience with AWS data platform services.
  • Ability to translate business needs into technical design and implementation.
  • Strong problem-solving skills and the ability to work independently on design discussions and solution delivery.
Preferred Skills
  • Experience with traditional ETL tools such as Informatica or Talend.
  • Familiarity with database technologies such as Oracle, MySQL, SQL Server, or Postgres.
  • Knowledge of data governance practices, including security, lineage, and catalog tools like Collibra or Alation.
  • Exposure to distributed messaging tools such as ActiveMQ, RabbitMQ, or Solace.
  • Experience with search/indexing and microservices architectures.
  • Background in performance tuning and data pipeline optimization.
  • Cloud data certifications or other relevant big data credentials.

Horizontal is committed to building an inclusive workplace where diverse perspectives are valued, respected, and encouraged. We welcome candidates from all backgrounds to apply and believe that equity and belonging strengthen our teams and the solutions we create.

By applying for this position, you acknowledge and agree that Horizontal Talent may contact you regarding your application using automated technology, including phone calls, SMS/text messages, or email, which may be delivered by our virtual AI recruiter, Alex.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10123528
  • Position Id: 75638
  • Posted 10 hours ago

Company Info

About Horizontal Talent

Horizontal Integration offers two service lines. Our staffing agency places IT, digital and creative talent in both contract and permanent roles. Our digital agency provides digital marketing strategy and technology consulting on a project basis. Many of our clients take advantage of both service lines.

We are a certified Minority Business Enterprise, with more than 200 employees across our offices in Minneapolis, Denver, Dallas and Vadodara, India. We ve been consistently growing and profitable since the company was founded in 2003.

Honors:
Recognized as a "2009 Best Place to Work" by Minneapolis/St.Paul Business Journal.

Fact:
Our people and our organization are deeply rooted in IT and interactive marketing.

Horizontal is proud to be an Equal Opportunity and Affirmative Action Employer. We seek to provide employment opportunities to talented, qualified candidates regardless of race, color, sex/gender including gender identity and/or expression, national origin, religion, sexual orientation, disability, marital status, citizen status, veteran status, or any other protected classification under federal, state or local law.

In addition, Horizontal will provide reasonable accommodations for qualified individuals with disabilities. If you need to request a reasonable accommodation in order to complete the application or interview process, please contact us. All applicants applying must be legally authorized to work in the country of employment.

About_Company_OneAbout_Company_Two
Contact the job poster
TJ

Tushar Jain

Recruiter @ Horizontal Talent
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Boston, Massachusetts

Today

Full-time

USD 31.00 - 64.00 per hour

San Francisco, California

Today

Full-time

Compensation information provided in the description

Search all similar jobs