Data Platform Engineer

Title: Data Platform Engineer

Location Address: Oaks, PA (Hybrid)

Type: Contract

Description:

POSITION OVERVIEW: Data Platform Engineer

Key Responsibilities:

• Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack.
• Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer to infrastructure. ? Demonstrate proficiency in coding skills, utilizing languages such as Python, Java, and Scala to efficiently move solutions into production while prioritizing performance, security, scalability, and robust data integrations.
• Collaborate seamlessly across diverse technical stacks, including Cloudera, Databricks, Snowflake, and AWS.
• Develop and deliver detailed presentations to effectively communicate complex technical concepts.
• Generate comprehensive solution documentation, including sequence diagrams, class hierarchies, logical system views, etc.
• Adhere to Agile practices throughout the solution development process.
• Design, build, and deploy databases and data stores to support organizational requirements.

Basic Qualifications:

• 4+ years of experience supporting Software Engineering, Data Engineering, or Data Analytics projects.
• 2+ years of experience leading a team supporting data related projects to develop end-to-end technical solutions.
• Ability to travel at least 25%.

Preferred Skills:

• Demonstrate production experience in core data platforms such as Snowflake, Databricks, AWS, Azure, Google Cloud Platform, Hadoop, and more.
• Possess hands-on knowledge of Cloud and Distributed Data Storage, including expertise in HDFS, S3, ADLS, GCS, Kudu, Elasticsearch/Solr, Cassandra, or other NoSQL storage systems.
• Exhibit a strong understanding of Data integration technologies, encompassing Spark, Kafka, eventing/streaming, Streamsets, NiFi, AWS Data Migration Services, Azure Data Factory, Google DataProc.
• Showcase professional written and verbal communication skills to effectively convey complex technical concepts.
• Undergraduate or Graduate degree preferred.