Migration work - Spark over Dataproc to Spark on serverless in Google Cloud PlatformOozie scheduler and knowledge on ComposerCapable to convert Oozie jobs to composer based jobsWriting new Composer DAGsValidation the data between source and destinationsHive QL migration to Spark SQLOwn the production jobs during warranty
Piper Companies is seeking a Data Engineer to cluster large datasets across various container and data platforms depending on external client needs. The Data Engineer will work hands-on with challenging data engineering, data management, and analytics projects. Responsibilities of the Data Engineer include: • Achieve and maintain proficiency with cluster and framework sizing, installation, debugging, performance optimization, migration, security and automation • C ollaborate with data scient
A little about us is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 750 clients, LTIMindtree brings extensive domain and technology expertise to help drive superior competitive differentiation, customer experiences, and business outcomes in a converging world. We provide our employee
We are looking for Data Engineer for our client in Irving, TX Job Title: Data Engineer Job Location: Irving, TX Job Type: Contract Job Description: Responsibilities Experience in data engineer , Data Analytics; Big Data Technologies Expert in Python.(Developer level Expertise expected), Programming experience in Python, R programming , Algorithms Spark, Kafka Good experience in the Data Models for ML; Reporting, Dash boarding; ML tools H2O, Tensor Flow, Prediction.io; Distributed Data Platforms
Piper Companies is looking for a Data Engineer for an Investment Firm in Wayne, PA for a Hybrid, Full-Time opportunity. Responsibilities of the Data Engineer: • Conduct data profiling, source-target mappings, ETL development, SQL tunings and optimization, testing and implementation • Provide business and technical analysis for initiatives focusing on Data Warehouse and Business Intelligence solutions • Collaborate with Business Intelligence Developers through dashboard and application developmen
Top Skills' Details Top skills: 1. Data Architecture - demonstrated understanding and worked within relational databases 2. Data Modeling - demonstrated understanding 3. ETL tool experience - they use Nifi and Kafka (for streaming) and transform into Snowflake (he looks for aptitude on type of skills but he'd consider datastage for these upcoming roles. (Talend is from an old JD, just a pre packaged list that populated) E and L done with Nifi and Kafka and then the T is within Snowflake. 4. Abil
Great opportunity with a stable organization! This Jobot Job is hosted by: Shokie Banerjee Are you a fit? Easy Apply now by clicking the "Apply Now" button and sending us your resume. Salary: $95,000 - $115,000 per year A bit about us: We are currently seeking a highly skilled and motivated MS Dynamics Data Engineer to join our dynamic team. The successful candidate will play a key role in managing and improving data systems within our financial company. This position involves working closely
Great opportunity with a stable organization! This Jobot Job is hosted by: Shokie Banerjee Are you a fit? Easy Apply now by clicking the "Apply Now" button and sending us your resume. Salary: $95,000 - $115,000 per year A bit about us: We are currently seeking a highly skilled and motivated MS Dynamics Data Engineer to join our dynamic team. The successful candidate will play a key role in managing and improving data systems within our financial company. This position involves working closely
Great opportunity with a stable organization! This Jobot Job is hosted by: Shokie Banerjee Are you a fit? Easy Apply now by clicking the "Apply Now" button and sending us your resume. Salary: $95,000 - $115,000 per year A bit about us: We are currently seeking a highly skilled and motivated MS Dynamics Data Engineer to join our dynamic team. The successful candidate will play a key role in managing and improving data systems within our financial company. This position involves working closely
Hi, Hope you are doing good!! I am Nagarjuna from Quant Systems Inc, One of my client is looking for Data OPS Engineer, Please let me know if you would like to move forward with the below position. Job Role : Data Ops Engineer Location : Dallas, TX – Onsite Day one onwards Duration : Contract Long Term Job Description Need Data Ops Engineer candidates
Position Summary What you'll do About the team: The mission of Walmart Display Ads is to connect brand owners and shoppers with relevant display ads. We bring brand awareness and rich product information to shoppers and help brand owners grow their business with advanced targeting and optimization techniques. This is a fast-growing business never lack ing opportunities ! We are looking for an experienced tech lead to spearhead advertising data analytics related to deman d, supply, and overall m
Fast growing AI powered Fintech startup / Python + AWS & Building Data Pipelines!! This Jobot Job is hosted by: Craig Rosecrans Are you a fit? Easy Apply now by clicking the "Apply Now" button and sending us your resume. Salary: $120,000 - $180,000 per year A bit about us: We are on the hunt for a highly skilled and passionate Senior Data Engineer to join our dynamic technology team. This is a permanent, full-time position where you will have the opportunity to shape the future of Fintech by
Fast growing AI powered Fintech startup / Python + AWS & Building Data Pipelines!! This Jobot Job is hosted by: Craig Rosecrans Are you a fit? Easy Apply now by clicking the "Apply Now" button and sending us your resume. Salary: $120,000 - $180,000 per year A bit about us: We are on the hunt for a highly skilled and passionate Senior Data Engineer to join our dynamic technology team. This is a permanent, full-time position where you will have the opportunity to shape the future of Fintech by
Job Description : Primary Skills :Apache Druid, Google Cloud Platform, Linux, Apache Airflow, Google Compute Engine, GitLab Google cloud platform - BigQuery, Compute engine, composer, GCS, Cloud SQL, Secondary Skills :Python, Pyspark, PL/SQL, Shell Script, Hive, Spark, SQL Please check if the candidate can handle these: > Druid components > Kafka to Druid streaming integration. > data flow process through Druid and how to debug the task failures or ingestion issues. > Druid SQL
Description 🚀 Ready to Revolutionize Backend Infrastructure and AWS Cloud Services? Join Us! 🚀 Are you a tech trailblazer with a knack for backend infrastructure and AWS cloud solutions? Our Enterprise Systems team is seeking a Lead Data Engineer to spearhead innovative solutions that seamlessly integrate the backbone of websites and applications. If you have a strong command of modern programming languages, web technologies, backend infrastructure, and AWS cloud services, we want you to make
Title: Senior Data Engineer Location: Los Angeles, CA OR NYC (3 days a Week onsite) Duration: 6 Months Looking for Senior Data Engineer with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join our Engineering team. If you enjoy designing and building innovative data engineering solutions using the latest tech stack in a fast-paced environment, this role is for you. Primary Job Duties and Responsibilities Collaborate with and across Agile team
Are you interested in joining a rapidly expanding Media/Fintech organization located in the City of Brotherly Love? Our client is dedicated to empowering Creators by enabling them to monetize their catalogs by licensing their existing videos (and/or future video uploads) and receiving instant cash. Creators can then use these funds to support their growth by recruiting resources, investing, or any other means they desire while maintaining their independence. This project entails collaborating to
Join a global company in the midst of thriving expansion as we embark on an exciting greenfield project. We're seeking a dedicated Data Engineer to play a pivotal role in our journey. If you're a hardworking team player with a proactive mindset and the ability to lead initiatives, we want you on our team! Job Title: Data Engineer Location: 100% Remote in the USA (Mountain Standard Time Zone Preferred) Hourly Rate: $60-70 per hour, Commensurate with Experience Key Qualities We're Looking For:
