Sr. BigData/Hadoop Admin with Agentic AI & Amazon MSK

We are seeking a highly skilled and proactive Bigdata engineer with strong SQL and AWS experience. The ideal candidate should have deep expertise in bigdata technologies , excellent in SQL skill, hands on experience with AWS services. Strong knowledge in SPARK, Bigdata ,SCALA, Hive and PYSPARKVery strong expertise in SQL queries10 plus years for experience in Bigdata ecosystemGood Understanding of AWS services , including EMR,EC2,S3,Athena, and GlueExperience in Technical design and solutioningS

High level overview: Engineer with experience in Scala, Python or Java, Big Data+ AWS/Databricks. Needs AI agent knowledge to create agents within the team to automate the processes Core skills: Data Engineering / Streaming Platforms (Kafka, real-time pipelines using scala/python, NIFI) Big Data Platforms (Spark, Hadoop/Ozone, Hive or impala, AWS, Databricks, cloudera manager platform) Production Support & Platform Reliability (using Splunk for monitoring, troubleshooting, performance tuning)Str

Job Summary We are seeking an experienced Hadoop Architect with strong expertise in designing, implementing, and optimizing large-scale Big Data platforms. The ideal candidate will have extensive experience with Hadoop ecosystem technologies, cloud-based data platforms, data architecture, and enterprise data solution Job Description Strong Hadoop architecture & administration experience (HDFS, YARN, Hive, Spark, Kafka, etc.) Expert knowledge of Cloudera ecosystem Hands-on AD/Kerberos authenti

Overview At Cotiviti, we are custodians of data for our clients. Using their technical experience in ETL processes, Data Engineers ensure operational functions are occurring as expected. This includes but is not limited to managing data implementations, data integrations, data production, data quality, and data security. Responsibilities Create, maintain and execute intermediate to advanced Spark scripts for data management and data validation, and data integration. Create, maintain and execu