PySpark/Spark Data Pipeline

Must Have Skills: Strong Spark + SQL transformation skillsRigorous data validation & reconciliation mindsetAbility to translate STM/business logic into working pipelinesExperience operating in structured, governed data ecosystemsPractical debugging and performance optimization skillsPython, SQL, Git and Linux skills are required.Preferrable experience in Jenkins, Apache Spark & Hadoop (Pandas is also good too), and object oriented programming.experience in working with wrangling data and buildi

Please Share profiles to below email ID''s Role: Data Engineer Location Remote Experience 10+ Years We are looking for a skilled Data Engineer with strong experience in SQL, Spark, and EDI to support data integration and processing initiatives. Key Responsibilities Develop and maintain data pipelines Work on SQL and Spark for data processing and optimization Handle EDI data and integrations Support data transformation and analytics requirements Collaborate with cross functional teams Mandatory S

job summary: We are seeking a highly experienced and hands-on Senior Data Engineer to join our Data Engineering teams. You will play a key role in supplementing existing capacity, upgrading our data architecture, and ensuring the highest quality, performance, and cost-efficiency of our data platforms. The work is focused on critical deliverables for personal investment, personal wealth, and comprehensive data analytics, while preparing the platform for a larger strategic move in the future. loc

Title : Data Engineer Location : Richardson , TX/ Dallas , TX Only Ex-GS resources. 5+ years of relevant work experience in a team-focused environment Independently develop software primarily to support the Extract, Transform, and Load (ETL) functionality for loading data to a data warehouse allowing business analysts and functional leaders to action business decisions based on that data. In depth knowledge of Spark and its working Write software using Python and Spark to automate data ingest