Overview
Skills
Job Details
Position: Big Data Engineer (Spark / Scala / Power BI)
Location: Redmond, WA (Remote)– Must work in PST time zone)
Duration: Long Term
Please share the resume at
Job Description
We are seeking an experienced Big Data Engineer with strong expertise in Apache Spark, Scala, SQL, and Power BI. The ideal candidate will be responsible for designing scalable data solutions, developing analytical workflows, and delivering interactive reports to support business decision-making.
Key Responsibilities
Design, develop, and maintain scalable big data solutions using Apache Spark and Scala.
Write and optimize complex SQL queries for data transformation and analytics.
Develop, optimize, and maintain Power BI dashboards for reporting and visualization.
Collaborate with cross-functional teams to integrate data pipelines and reporting solutions.
Ensure data quality, security, and compliance across all systems.
Required Skills & Experience
Strong proficiency in Apache Spark with hands-on experience in Scala.
Solid understanding of SQL for data manipulation and analysis.
Experience in Power BI for building interactive dashboards and reports.
Familiarity with distributed computing and big data ecosystems (Hadoop, Hive, etc.).
Ability to work with large datasets and optimize data workflows.
Highly Desirable Skills
Spark performance tuning and optimization expertise.
Knowledge of cluster resource management and resolving performance bottlenecks.
Experience with Azure big data services (Azure Data Lake, Databricks, Synapse).
Exposure to cloud platforms like AWS or Google Cloud Platform.
Experience working in financial domain or with ERP systems (SAP, Oracle ERP).
Understanding of regulatory and compliance requirements in financial data processing.
Additional Qualifications
Strong analytical and problem-solving skills.
Excellent communication and team collaboration abilities.
Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.