Pyspark Developer
Ideate Technologies LLC
Dice Job Match Score™
🔢 Crunching numbers...
Job Details
Skills
- Data Engineering
- Data Processing
- Pyspark
- Python
- Databricks
- ETL
- Hadoop
- AWS
- Data Pipelines
Summary
Mandatory Skills & Requirements
PySpark
Python
Databricks
ETL
Hadoop
AWS
Strong experience in scalable data pipeline development and large-scale data processing
Data transformation and ETL workflow development
Experience with Databricks Lakehouse Platform
Key Responsibilities
Design, build, and optimize scalable data pipelines.
Process large datasets using PySpark.
Develop efficient data transformation and ETL workflows.
Implement data engineering solutions on the Databricks Lakehouse Platform.
Support reliable, scalable, and high-performance data processing requirements.
Preferred Skills
AWS, Azure, or Google Cloud Platform
SQL
Delta Lake
Data pipeline and PySpark performance tuning
- Dice Id: PTPLpHtkHbcJfPL
- Position Id: 438308
- Posted 10 hours ago
Company Info
About Ideate Technologies LLC
Ideate Technologies is a full-service IT Organization providing Custom Software Development, Cloud Services, Technology Consulting, Business Automation, System Integration, Business Intelligence, Big Data and Data Analytic Solutions. Services we offer are built on our more than two decades of rich industry experience, technological competence and operational excellence. Our services are designed to help organizations efficiently and effectively address their business needs and challenges across multiple domains.
Constant changes in the technology landscape, cost of software development and fastest time to market are some of the challenges businesses face today, Ana-Data's services and engagement models are structured to address every one of these challenges.