Title: Software Engineer - Onsite
Mandatory skills:
coding, Python, production software deployment,
Big data, data sources,
cloud computing, AWS services, IAM, Lambda, S3, RDS,
weather data acquisition, processing, analysis products, weather service, cloud-based solutions stack,
AWS, Databricks solutions, backend systems, ingest, cache, process terabyte, petabyte level weather data, IBM Weather Company API,
system requirements, build backlog, prioritize work, system scalability, optimize workflows,
Build infrastructure as code, Terraform, CI/CD pipelines, GitHub Actions,
REST APIs, backend processes, AWS Chalice, Lambda, historical, forecast weather data,
containerization, Docker, caching, Redis, databases, PostgreSQL, PostGIS
Description:
General Description:
We are looking for a highly technical engineer to build and support weather data acquisition, processing, and analysis products, including our weather service, using a cloud-based solutions stack. We are open to early or advanced career candidates with strong examples of novel contributions and highly independent work in a fast-paced software delivery environment.
Essential attributes/experience:
Excellent coding skills (Python) with production software deployment experience
Big data experience (terabyte or petabyte level data sources)
Core understanding of cloud computing (e.g., AWS services like IAM, Lambda, S3, RDS)
Example Responsibilities (including but not limited to):
Architect and propose new AWS/Databricks solutions & updates to existing backend systems that ingest, cache, and process terabyte and petabyte level weather data (e.g., from IBM Weather Company API)
Work closely with the product management team and end users to understand customer experience and system requirements, build backlog, and prioritize work
Build infrastructure as code (e.g., Terraform)
Improve system scalability and optimize workflows to reduce cloud costs
Create and update REST APIs and backend processes (e.g., AWS Chalice/Lambda) for current, historical, and forecast weather data
Build/support solutions involving containerization (e.g., Docker), caching (Redis), and databases (e.g., PostgreSQL/PostGIS)
Support Databricks/Spark pipelines for historical weather data backfill into S3 (Parquet/Delta Lake) and data analysis (SQL/PySpark)
Migrate and maintain CI/CD pipelines (e.g., GitHub Actions)
Enhance monitoring and alerting for weather systems (e.g., Datadog)
Enable field testing and customer support operations by debugging and fixing data issues
Work with data scientists to scalably fetch and manipulate large weather data sets for models and analysis
VIVA USA is an equal opportunity employer and is committed to maintaining a professional working environment that is free from discrimination and unlawful harassment. The Management, contractors, and staff of VIVA USA shall respect others without regard to race, sex, religion, age, color, creed, national or ethnic origin, physical, mental or sensory disability, marital status, sexual orientation, or status as a Vietnam-era, recently separated veteran, Active war time or campaign badge veteran, Armed forces service medal veteran, or disabled veteran. Please contact us at for any complaints, comments and suggestions.
Contact Details :
Account co-ordinator: Jothimani Natarajan
VIVA USA INC.
3601 Algonquin Road, Suite 425
Rolling Meadows, IL 60008
|
Never miss an opportunity! Create an alert based on the job you applied for.