Data Engineer

Hi There

We have a job opportunity for Data Engineer with our direct client.

Please have a look into the below Job description and let me know your interest

Role: Data Engineer

Location: Bentonville, AR

Client: UST Global

Description: We are seeking a Data Engineer with Spark & Streaming skills builds real-time, scalable data pipelines using tools like Spark, Kafka, and cloud services (Google Cloud Platform) to ingest, transform, and deliver data for analytics and ML.

Responsibilities:

·        Design, develop, and maintain ETL/ELT data pipelines for batch and real-time data ingestion, transformation, and loading using Spark (PySpark/Scala) and streaming technologies (Kafka, Flink).

·        Build and optimize scalable data architectures, including data lakes, data warehouses (BigQuery), and streaming platforms.

·        Performance Tuning: Optimize Spark jobs, SQL queries, and data processing workflows for speed, efficiency, and cost-effectiveness

·        Data Quality: Implement data quality checks, monitoring, and alerting systems to ensure data accuracy and consistency.

Required Skills & Qualifications:

·        Programming: Strong proficiency in Python, SQL, and potentially Scala/Java.

·        Big Data: Expertise in Apache Spark (Spark SQL, DataFrames, Streaming).

·        Streaming: Experience with messaging queues like Apache Kafka, or Pub/Sub.

·        Cloud: Familiarity with Google Cloud Platform, Azure data services.

·        Databases: Knowledge of data warehousing (Snowflake, Redshift) and NoSQL databases.

·        Tools: Experience with Airflow, Databricks, Docker, Kubernetes is a plus.

Thanks & Regards,

Kannan Nagarajan

Technical Recruiter

C

E innovatixinc.com