Data Engineer


Learn Beyond Consulting LLC
Dice Job Match Score™
🫥 Flibbertigibetting...
Job Details
Skills
- Google Cloud Platform
- Optimization
- Performance Tuning
- Distributed Computing
- Extract
- Transform
- Load
- Good Clinical Practice
- Microsoft Azure
- PySpark
- Python
- SQL
- Data Extraction
- Data Lake
- Data Processing
- Data Quality
- Data Warehouse
- Jersey
- Amazon Web Services
- Apache Spark
- Big Data
- Cloud Computing
- Data Engineering
- Unstructured Data
- ELT
Summary
- Design, develop, and maintain scalable data pipelines using PySpark and Spark.
- Process and transform large volumes of structured and unstructured data.
- Write optimized SQL queries for data extraction, transformation, and analysis.
- Develop robust data processing solutions using Python.
- Work closely with data analysts, data scientists, and business teams to support data-driven initiatives.
- Ensure data quality, performance optimization, and reliability of data pipelines.
- Troubleshoot and resolve data processing issues in production environments.
- 8+ years of experience in Data Engineering or related roles.
- Strong hands-on experience with PySpark and Apache Spark.
- Advanced proficiency in SQL and Python.
- Experience building large-scale ETL/ELT pipelines.
- Strong understanding of data processing and distributed computing concepts.
- Experience working with large datasets and data warehousing solutions.
- Experience with cloud platforms (AWS / Azure / Google Cloud Platform).
- Knowledge of data lake and big data architectures.
- Experience with performance tuning and optimization in Spark environments.
- Dice Id: 91126603
- Position Id: 8913010
- Posted 2 hours ago
Company Info
About Learn Beyond Consulting LLC
Our company was established with primary goal to deliver quality and cost effective IT consultancy and support to everyone who requires them.
Learn Beyond Consulting is a global consulting powerhouse. We are a team of high-skilled professionals who care about the level of information technology integration in modern business. As a team collectively We have more than 50 years of experience in IT industry..
We achieved our success because of how successfully we integrate with our clients. One complaint many people have about consultants is that they can be disruptive. Employees fear outside consultants coming in and destroying the workflow. Our clients face no such issues.
We believe in partnering, through close association with our clients to first understand and define what is truly needed, and then jointly work to create complete, customized business solutions tailored to their unique requirements.
Our methodology includes a very advanced approach to performance management ensuring the desired results are defined in clear measurable terms.
Our Vision is To provide Continuous Value Addition to our Clients by leveraging the Latest and most Innovative Technologies by Delivering Excellent Business Solutions.
We understand that each client has his own unique needs, definition of value, which must be sustained over a period of time as conditions and priorities change
