Data Engineer

Immediate need for a talented Data Engineer . This is a 17+months contract opportunity with long-term potential and is located in Durham, NC (Onsite). Please review the job description below and contact me ASAP if you are interested.

Job ID:25-77331

Pay Range: $65 - $70/hour. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location).

Key Requirements and Technology Experience:

• Key Skills: Data Engineering
• Expert Level Scala
• Some Java knowledge
• Amazon EMR
• Cassandra DB or any distributed database experience
• Nice to have: If they have worked on any streaming platform ideally with Kafka.
• Bachelor s degree in computer science, Information Systems, or a related field.
• Proven track record in data engineering with over 10 years of experience developing Spark or Spring Batch services for data movement.
• Responsibilities include scheduling, monitoring, and debugging ETL processes using Spring Batch and Spark Batch.
• Hands-on experience with Java clients for consuming REST and SOAP APIs, as well as Scala for Spark batch applications.
• Develop, test, deploy, and maintain ETL batch jobs using Spring Batch and Apache Spark/EMR jobs.
• Utilize the Apache Spark cluster-computing framework to process big data and write to NoSQL databases such as Cassandra or Yugabyte.
• Experience with cloud-based data warehousing and data lake solutions, such as Snowflake.
• Familiarity with data storage and management for large datasets, including formats like Parquet and HDF5.
• Proven experience in building and deploying software solutions utilizing services from public cloud providers like AWS.
• Champions innovative technology solutions to address complex business challenges.
• Collaborates across teams to identify opportunities for organization-wide technology initiatives.
• Brings external information, ideas, and expertise back to the team.
• Possesses a solid understanding of the software development process, including analysis, design, coding, system and user testing, problem resolution, and planning.
• Identifies creative ways to achieve desired outcomes and promotes a culture of innovation by setting examples.
• Engages with peers through code reviews, pair programming, and interactive discussions on a daily basis.
• Comfortable working across multiple teams and adaptable to change.
• Embraces a customer-first mentality and enjoys developing user-friendly web applications that solve real-life problems.
• Has a passion for adhering to outstanding software engineering practices and continuously seeks to improve engineering skills and industry knowledge.
• Applies a data-driven and collaborative approach to decision-making, both in day-to-day tasks and in making strategic trade-offs.

Our client is a leading Financial Industry, and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration.

Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, colour, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy .