Overview
Skills
Job Details
Location Buffalo/Niagra Falls Area - Hybrid Work week
Full Time Employee plus benefits.
Support the day-to-day operations of Invisible deployments. Our customers rely on our platform for some of their most critical operations.
Build, optimize, and maintain ETL pipelines
Modify existing application code or interfaces, or develop new components
Analyze requirements, participate in design, and handle coding, testing, debugging, deployment, and maintenance
Develop and implement databases, data collection systems, and data analysis strategies for better efficiency and quality
Conduct code and design reviews to maintain a high-quality product
Mentor and guide Junior colleagues and new team members
Collaborate with other Data Engineers and Forward deploy engineers and Platform engineers to prioritize business needs
Share technical insights with the wider engineering teams
What We Need
3+ years of hands-on experience in software development and/or Big Data
Excellent knowledge of Python
Proficiency in PySpark and strong understanding of Spark
Experience in building and maintaining Data Lakes or Data Warehouses (preferably Snowflake or Databricks)
Strong understanding of ETL frameworks (e.g., dbt)
Good knowledge of AWS (IAM, S3, and Security Groups)
Familiarity with Infra-as-Code (Terraform or similar)
Great communication skills: able to articulate status updates, blockers, and design considerations
Ability and interest to travel up to 30% of the time for meetings with clients