Apply Now

Backend Engineer _ AI Gateway- Bilingual (Korean/ English)

Plano, TX, US • Posted 2 hours ago • Updated 2 hours ago

Full Time

On-site

Fitment

Dice Job Match Score™

To see how well you match this job, please log in or create an account.

Once logged in, be sure to complete your profile to get the most accurate match score.

🔢 Crunching numbers...

Job Details

Skills

English
Leadership
IaaS
Python
Network Programming
TCP
UDP
Sockets
WebSocket
Servers
Real-time
HTTP
Multiplexing
Dependency Injection
Kubernetes
Docker
Messaging
Redis
Streaming
RabbitMQ
Apache Kafka
PostgreSQL
Query Optimization
Encryption
Cloud Computing
Computer Networking
Load Balancing
TLS
Proxies
Nginx
Continuous Delivery
Terraform
GitHub
GitLab
Continuous Integration
DLP
Microsoft SharePoint
Auditing
SAML
OIDC
SSO
Management
Provisioning
Artificial Intelligence
Prompt Engineering
Workflow
API
Microsoft Azure
Incident Management
SLA
Bilingual
Korean

English
Leadership
IaaS
Python
Network Programming
TCP
UDP
Sockets
WebSocket
Servers
Real-time
HTTP
Multiplexing
Dependency Injection
Kubernetes
Docker
Messaging
Redis
Streaming
RabbitMQ
Apache Kafka
PostgreSQL
Query Optimization
Encryption
Cloud Computing
Computer Networking
Load Balancing
TLS
Proxies
Nginx
Continuous Delivery
Terraform
GitHub
GitLab
Continuous Integration
DLP
Microsoft SharePoint
Auditing
SAML
OIDC
SSO
Management
Provisioning
Artificial Intelligence
Prompt Engineering
Workflow
API
Microsoft Azure
Incident Management
SLA
Bilingual
Korean

Summary

Company Description

For More Open Positions Visit us at:
;/strong>

Our Mission

WOONGJIN INC. is a rapidly growing team who provides a range of unique, exceptional, and enhanced services to our clients. We have a strong moral code that includes the service of goodness without expectations of reward. We are motivated by the sense of responsibility and servant leadership.

Job Description

We are building an AI Gateway - a high-performance, secure intermediary layer that routes, inspects, and governs all traffic between enterprise clients and LLM/AI service providers. This role requires deep expertise in network programming, async Python, and cloud infrastructure to design and operate a latency-sensitive, policy-driven gateway that handles massive concurrent streaming connections at scale.

What we are looking for
Async Python & Network Programming (3 + yrs) - Strong hands-on experience with asyncio, aiohttp/anyio, low-level TCP/UDP sockets, WebSocket & SSE servers, TLS handshake, connection-pooling, keep-alive, and zero-copy buffering.
Streaming & Large-Payload Handling - Ability to manage chunked transfer, bidirectional streaming, back-pressure and high-throughput data paths for real-time LLM inference.
Protocol Knowledge - Working familiarity with HTTP/2 & HTTP/3 (multiplexing, HPACK), gRPC, and occasional custom protocol parsers.
FastAPI-Based Backend (3 + yrs) - Design, develop and test production-grade REST/Streaming APIs; pragmatic use of Pydantic, dependency injection and OpenAPI docs.
Containerization & Kubernetes - Docker, AKS/EKS/GKE deployment experience; HPA/VPA scaling, rolling updates, and service-mesh (e.g., Istio/Envoy) basics.
Async Messaging & Event-Driven Design - Production use of Redis Streams, RabbitMQ or Kafka for decoupled task queues, retries and back-off logic.
PostgreSQL & Vault - Advanced query tuning, partitioning, PgBouncer pooling, plus HashiCorp Vault (dynamic secrets, transit encryption) for key management.
Cloud Networking & Security - L4/L7 load balancing, TLS termination, reverse-proxy (NGINX/Envoy), mTLS between services, and automated cert lifecycle (ACME/Let's Encrypt).
IaC & CI/CD - Terraform modules for multi-env infra, plus GitHub Actions/GitLab CI pipelines with container image scanning and canary/blue-green deployments.

Qualifications
Enterprise Security Gateways - Integration with CASB/DLP/WSS or similar edge-security platforms; centralized logging & audit trails.
IAM & SSO - Configuring Azure AD/Entra ID, Okta, SAML 2.0 or OIDC SSO flows; managing Conditional Access & SCIM provisioning.
AI/LLM Pipelines - Building prompt-engineering workflows, PII anonymisation, and monitoring Azure OpenAI (or comparable) usage, rate limits & cost.
API-Gateway Operations - Custom webhook/REST integrations, circuit-breaker patterns, rate-limiting, auto-retry and health-checking.
Observability & FinOps - End-to-end monitoring with Datadog, PrometheGrafana or Azure Monitor; proactive cost-optimisation and 24/7 incident response (SLA/SLO).
Bilingual Korean Highly Prefer

Additional Information

All your information will be kept confidential according to EEO guidelines.

*****NO C2C******

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Dice Id: 90803333
Position Id: 10ea928fc506e467336822810af52745
Posted 2 hours ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Cinter Career
Backend Engineer - AI Gateway (Bilingual Korean)
Plano, Texas
•
Today
Job Details Job Title: Backend Engineer - AI Gateway Client: Korean IT Services and IT Consulting Working Location: NJ then Plano TX Working Style: Onsite Employment Type: 1 year Contract / W-2 Salary: $100K-120K annually (DOE) Benefit: 401K Match and Insurance Visa Support: No Working Hours: 9AM to 6PM Language: English and Bilingual Korean Highly Preferred Position Summary We are building an AI Gateway - a high-performance, secure intermediary layer that routes, inspects, and governs all traff
Full-time
USD 100,000.00 - 130,000.00 per year

Genesis10
Full Stack Engineer
Plano, Texas
•
Today
Genesis10 is currently seeking a Full Stack Engineer for a contract position with a Global Financial Institution located in Pennington, NJ or Charlotte, NC. This is a 12+ month contract opportunity. This role emphasizes full ownership of a FastAPI microservice integrated with an enterprise agentic AI platform. The ideal candidate is a self-sufficient full stack engineer with deep backend expertise who can identify scope, drive work independently, and deliver production-quality software. The posi
Easy Apply
Full-time
Compensation information provided in the description

Apex Systems
Full Stack Software Engineer - Python/FastAPI
Plano, Texas
•
Today
Job#: 3049102 Job Description: Full Stack Software Engineer - Python/FastAPI Location: Plano, Texas (Onsite) Role Overview This role emphasizes full ownership of a FastAPI microservice integrated with an enterprise agentic AI platform. The position requires a self-sufficient full stack engineer with deep backend expertise who can identify scope, drive work independently, and deliver production-quality software. The successful candidate will own and lead the development, maintenance, and evol
Easy Apply
Full-time
$91 - $93 per hour

JPMorgan Chase & Co.
Lead Software Engineer - Python, AWS, Agentic AI (ADK/LangGraph)
Plano, Texas
•
Today
Job Description Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products. As a Lead Software Engineer at JPMorganChase within Cloud Foundation Services, you are a hands-on technical leader on an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. You will drive business impact by owning end-to-end design and delivery of critical syst
Full-time

Search all similar jobs

More jobs at WOONGJIN, INC in Plano, TX