Data Architect ( Spark, PySpark, and Python) | Full Time Position | Remote

Overview

Remote
Depends on Experience
Full Time

Skills

Python
Data Architect
spark

Job Details

Data Architect
    • Location: Remote
    • Employment Type: Full-time Position
    • Experience: 9+ yrs exp
    • Must have : Data Architect , Spark , Pyspark , Python
We are currently seeking a skilled and experienced Data Architect to join our team. The ideal candidate will have a strong background in data architecture, along with expertise in Spark, PySpark, and Python. As a Data Architect, you will play a critical role in designing and implementing data solutions to support our organization's objectives.
Responsibilities:
  • Design and develop robust data architecture solutions to meet the needs of our organization.
  • Collaborate with stakeholders to understand business requirements and translate them into technical specifications.
  • Implement data pipelines using Spark and PySpark for data ingestion, processing, and transformation.
  • Design and maintain data models, schemas, and data dictionaries to ensure data consistency and integrity.
  • Develop and optimize ETL processes to extract, transform, and load data from various sources into our data ecosystem.
  • Implement data storage solutions, including data lakes and data warehouses, to support analytics and reporting requirements.
  • Perform data quality analysis and implement data cleansing and validation processes to ensure data accuracy and reliability.
  • Provide technical guidance and support to development teams on best practices for data architecture, design, and implementation.
  • Stay up-to-date with advancements in data management technologies and best practices.
  • Collaborate with infrastructure and operations teams to ensure the scalability, availability, and performance of data systems.
Mandatory Skills:
  • Proven experience as a Data Architect or a similar role.
  • Expertise in Spark and PySpark for large-scale data processing.
  • Proficiency in Python programming language for data manipulation and analysis.
Preferred Qualifications:
  • Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
  • Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
  • Knowledge of data visualization tools such as Tableau or Power BI.
  • Strong analytical and problem-solving skills.
  • Excellent communication and interpersonal skills.

If you are a talented Data Architect with expertise in Spark, PySpark, and Python, we encourage you to apply for this exciting opportunity. Join our team and contribute to the development of innovative data solutions that drive our organization's success.