Overview
Remote
Depends on Experience
Full Time
Skills
Python
Data Architect
spark
Job Details
Data Architect
Responsibilities:
If you are a talented Data Architect with expertise in Spark, PySpark, and Python, we encourage you to apply for this exciting opportunity. Join our team and contribute to the development of innovative data solutions that drive our organization's success.
- Location: Remote
- Employment Type: Full-time Position
- Experience: 9+ yrs exp
- Must have : Data Architect , Spark , Pyspark , Python
Responsibilities:
- Design and develop robust data architecture solutions to meet the needs of our organization.
- Collaborate with stakeholders to understand business requirements and translate them into technical specifications.
- Implement data pipelines using Spark and PySpark for data ingestion, processing, and transformation.
- Design and maintain data models, schemas, and data dictionaries to ensure data consistency and integrity.
- Develop and optimize ETL processes to extract, transform, and load data from various sources into our data ecosystem.
- Implement data storage solutions, including data lakes and data warehouses, to support analytics and reporting requirements.
- Perform data quality analysis and implement data cleansing and validation processes to ensure data accuracy and reliability.
- Provide technical guidance and support to development teams on best practices for data architecture, design, and implementation.
- Stay up-to-date with advancements in data management technologies and best practices.
- Collaborate with infrastructure and operations teams to ensure the scalability, availability, and performance of data systems.
- Proven experience as a Data Architect or a similar role.
- Expertise in Spark and PySpark for large-scale data processing.
- Proficiency in Python programming language for data manipulation and analysis.
- Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
- Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
- Knowledge of data visualization tools such as Tableau or Power BI.
- Strong analytical and problem-solving skills.
- Excellent communication and interpersonal skills.
If you are a talented Data Architect with expertise in Spark, PySpark, and Python, we encourage you to apply for this exciting opportunity. Join our team and contribute to the development of innovative data solutions that drive our organization's success.