Scala Sparks Developer

Hi,

I would like to share an excellent opening Contact Scala Sparks Developer do go through the details and kindly send me the updated resume.

Location : NYC, NY (Hybrid)- Local Candidate
Type of Hire : Contract
Mode of interview : WebEx / Teams /2^nd round in person

Job Summary:

Key Responsibilities

• Develop, test, and maintain scalable data processing pipelines using Scala and Apache Spark.
• Implement data transformation and ETL workflows to handle structured and unstructured data.
• Utilize Python for data processing, scripting, and integrating Spark workflows.
• Optimize performance of Spark applications through tuning, partitioning, and caching strategies.
• Participate in code reviews, design discussions, and ensure adherence to best practices.
• Document workflows, architecture, and solutions for internal knowledge sharing.

Required Qualifications

• Strong experience in Scala and Apache Spark (Spark Core, Spark SQL, DataFrames, RDDs).
• Proficiency in Python for data manipulation, scripting, and automation.
• Proven experience with distributed computing concepts and large-scale data processing.
• Knowledge of ETL development, data warehousing, and data modeling techniques.
• Familiarity with Big Data ecosystems such as Hadoop, Hive, Kafka, or HBase is a plus.
• Excellent communication and collaboration skills.

Preferred Qualifications

• Experience with cloud platforms such as AWS, Google Cloud Platform, or Azure (particularly with Spark services).
• Familiarity with streaming data processing using Spark Streaming or Structured Streaming.
• Knowledge of data governance, security, and compliance practices.
• Basic understanding of machine learning workflows is advantageous.

Thank you in advance for your attention and continued support.

Thanks and Regards,

Abrar Shaikh
_________________________________________________
Ztek Consulting Inc.,

Phone: Office: / Cell :

E-mail:

Visit us at

LinkedIn Profile:

____________________________________________