Lead Big Data Engineer

Big data, Scala, Spark, AWS, Java, Cloud, Amazon S3, Amazon Redshift, Amazon EC2, NoSQL, hive
Contract Corp-To-Corp, 12 Months
Depends on Experience
Travel not required

Job Description

 Impetus Technologies is a software products and services company focused on creating powerful and intelligent enterprises through deep data awareness, data integration and advanced data analytics. Our products and services are designed to empower the real-time data driven enterprise, to help our clients win in the modern world of digital transformation.

Impetus has won several awards and creditable and global organizations have recognized and appreciated our passion for technology and great work culture. Our employees are our greatest assets.

We are currently expanding our talent pool; those who’d like to add to their experience of working on cutting- edge technologies in the global IT industry today are welcome to join us.

Your responsibilities include:

  • Implement various solutions arising out of large data processing (GB’s/ PB’s) over various NoSQL, Hadoop and MPP based products—both on-premise and in the cloud
  • Actively participate in various architecture and design calls with big data customers
  • Develop Hive scripts and be involved in writing MapReduce jobs
  • Implement complex projects dealing with the considerable data size (GB/PB) and with high complexity
  • Leverage your experience with Hadoop and software engineering to help our clients drive value from their data
  • Work with Sr. Architects and providing implementation details to offshore
  • Conduct sessions/ writing whitepapers/ Case Studies pertaining to big data
  • Responsible for timely and quality deliveries.
  • Fulfill organization responsibilities – sharing knowledge and experience with other, passionate Impetus professionals, conducting various technical development sessions and training on new technologies

About you:

  • You think out of the box and are passionate to chase your dreams in the Big data space
  • You’re self-motivated and want to make an impact by helping customers explore their data to uncover hidden insights
  • You like to innovate and help customers find simple solutions to complex problems that has not been solved through legacy technologies
  • You like to work where teams collaborate to craft transformational strategies


You Have:

  • At least 8 years of experience in IT and at least 5 years using Big Data on AWS 
  • Hands-on experience with using Cloud Platform provided Big Data technologies and equally non-big data technologies 
    • g. EC2, EMR, RedShift, S3 in Amazon Web Services 
  • Hands-on experience in setting up Cloud platforms for Client’s use-cases 
  • Good and practical scripting knowledge in Java ( core java ) and J2EE technologies, Python 
  • Good knowledge in Big Data technologies – Hadoop, Spark, Hive
  • Experience using programming frameworks -  Spark, PySpark, Scala 
  • Experience or learning ability in NoSQL Technologies – MongoDB, DynamoDB
  • Good knowledge of Big Data, Relational Database, Data Architecture concepts 
  • Strong analytical, problem-solving, data analysis and research skills 
  • Good people management skills to manage, guide and mentor a technical team 
  • Ability to work with various business teams to resolve technical challenges and understand requirements
  • Demonstrable ability to interact, collaborate, drive consensus and confidence among  different (of our) groups – both on-shore and off-shore
  • Demonstrable ability to think outside of the box and not be dependent on readily available tools 
  • Excellent communication, presentation and interpersonal skills are a must 
  • If someone has experience with Data Science tools & technologies on Cloud ( e.g. AWS SageMaker) that’s welcome, but not mandatory 
  • If someone has data analytics product development experience on Cloud, that’s welcome too, but not mandatory 
  • Knowledge of Palantir Foundry is welcome but not mandatory


Why work at Impetus

  • Work in an innovation driven environment to solve real tech problems in Big Data, AI, Cloud and IOT
  • Work with thought leaders that include published authors, industry conference speakers and open source contributors
  • A culture of empowerment where you have the opportunity to be mentored by leading tech gurus
  • A culture of lifelong learning that includes trainings, certifications, tech talks and tech connect
  • Company paid medical/dental/vision/life coverage
  • Paid time off including holidays and vacation
  • Have fun while you work in a diverse environment

At Impetus we are committed to diversity and support an inclusive workplace. We are an equal opportunity employer.


If this is not the job for you, share the link with a friend who will be interested

Dice Id : 10118066
Position Id : 6948570
Originally Posted : 2 months ago
Have a Job? Post it