StructuredFor DevelopersSystem Design & Architecture

Load Balancer & Traffic Management Design.

When designing or reviewing the entry point of a distributed system.

ChatGPT Β· Claude Β· GeminiΒ·IntermediateΒ·~900 tokens
Curated by the AIPP team
Last updated 14 May 2026 Β· v3
load-balancer-traffic-management-design-4.md Β· 900 words
You are a senior {{role}} brought in to help a developer or tech professional complete a {{use_case}} task.

# Context
- Pack: Developers & Tech Professionals
- Category: System Design & Architecture
- Use case: Load Balancer & Traffic Management Design
- Source task:
  - Design the load balancing and traffic management layer for {{describe_system}}. Include:
  - 1. load balancer type (L4 vs. L7) with rationale
  - 2. load balancing algorithm (round-robin, least-connections, IP hash, weighted) and when to choose each
  - 3. health check design (what to check, how often, failure threshold)
  - 4. session affinity requirements and how to handle stateful sessions
  - 5. SSL termination strategy
  - 6. traffic splitting for blue-green or canary deployments

# Goal
Load balancer type, algorithm, health check design, session strategy, SSL plan, and traffic splitting approach for safe deployments.

# Constraints
- Produce a complete, usable first draft in one response.
- Avoid generic filler, vague advice, and unsupported claims.
- Make the output specific, practical, and ready to use.

# Output
Load balancer type, algorithm, health check design, session strategy, SSL plan, and traffic splitting approach for safe deployments.

The variables to fill in

PlaceholderWhat to put thereExample
{{role}}Rolenetwork architect
{{use_case}}Your specific valueload balancer & traffic management design
{{describe_system}}Describe systemExample describe system

How to customize this prompt

  1. Replace each {{double-curly}} with your real context.
  2. Adjust the constraints section to match your tone β€” formal, casual, blunt.
  3. If the engagement is recurring, change the duration line to mention milestones rather than days.
  4. Run it in your tool of choice. The output should be ready to paste with at most one small edit.

When to use

When designing or reviewing the entry point of a distributed system.

PRO TIP

Design health checks that test application logic, not just TCP connectivity β€” a server that accepts connections but returns errors should fail health checks.

Related prompts

Structured

Blog Post Drafting Engine

Write a complete, SEO-optimised blog post on the given topic. Include a compelling headline, an engaging introduction, 4-5 subheadings with detailed body paragraphs, and a strong conclusion with a cal

Structured

Email Newsletter Writer

Write a complete email newsletter including subject line, preview text, opening hook, main body content (3 short sections), and a clear call to action.

Structured

YouTube Video Script Writer

Write a complete YouTube video script including a strong hook (first 30 seconds), structured main content with transitions, and a closing that encourages likes, comments, and subscriptions.

Structured

LinkedIn Article Builder

Write a complete LinkedIn article that establishes professional authority, shares a genuine insight, and encourages professional discussion.

β˜… THIS PROMPT IS IN A PACK

The Developer Toolkit Pack

250 technical prompts for code review, documentation, architecture planning, debugging, test writing, API design, and career growth β€” built by developers for developers.

Browse more prompts β†’