Hadoop Developer

About the Company Blackstraw.ai is an end-to-end technology services company specializing in Artificial Intelligence (AI) and Engineering solutions across Data Science, Data Engineering, LLM/GenAI and LLMOps. Founded in 2018, we help global enterprises across North America, Europe and Asia to build and operationalize AI systems that create measurable business impact. Our mission is to make AI adoption simpler, faster and scalable through a blend of deep domain expertise, reusable accelerators an

job summary: We are seeking a senior-level Big Data Engineer with hands-on experience migrating enterprise Cloudera Hadoop workloads to AWS. The ideal candidate has deep expertise in HDFS, Hive, Spark, Oozie, Python, shell scripting, and AWS services including EMR, Glue, Airflow, and Lambda. This role will lead migration planning, target architecture design, application replatforming, validation, and technical documentation. location: Telecommute job type: Contract salary: $75 - 80 per hour

Net Orbit Inc has openings for the position Big Data Testing Engineer. Project Location: Remote / El Segundo, CA 90245 Job Description: (Current Roles & Responsibility): Validation of data using sqoop and shell scripts. Hands on HQL, hdfs files, partitioning, data load, mock data prep and queries writing in hive/impala Writing queries using joins and using db Managing hdfs directories using UNIX/Linux Writing test automation scripts etc Work location is Tempe, AZ with required travel to client

Required QualificationsMinimum 7 years of experience developing enterprise-scale distributed data processing applications. Strong hands-on development experience with Scala. Experience developing applications using Apache Spark 2.x and/or Spark 3.x. Experience developing and maintaining applications running on Cloudera Data Platform (CDP) 7.x or equivalent enterprise Hadoop distributions. Experience with Apache Hive 3.x for data processing and Hive table management. Experience implementing busin