Files

T

meiseayoung 9eb360926b feat(usockets): optimize high concurrency support up to 10,000+ connections

- Increase uSockets listen() backlog from 512 to 16384 in bsd.c
- Add high concurrency test suite (5000-10000 concurrent connections)
- Add HIGH_CONCURRENCY.md documentation with optimization guide
- Add usockets/build.sh script for rebuilding uSockets library
- Update README with latest benchmark results

Performance (macOS M3 Max):
- 5,000 concurrent: 81,524 RPS, 100% success
- 10,000 concurrent: 24,198 RPS, 100% success

System requirements:
- kern.ipc.somaxconn >= 8192
- ulimit -n 65535

2026-01-03 20:45:30 +08:00

2.6 KiB

Raw Blame History

uSockets Backend for V-Hono

High-performance server backend using uSockets library.

High Concurrency Performance

The included libusockets_full.a has been optimized with backlog=16384 to support high concurrency:

Concurrent	RPS	Success Rate
4,000	112,614	100%
6,000	56,728	100%
8,000	33,255	100%
10,000	25,964	100%

System Requirements

For 10,000+ concurrent connections:

# macOS
sudo sysctl -w kern.ipc.somaxconn=8192
ulimit -n 65535

# Linux
sudo sysctl -w net.core.somaxconn=8192
ulimit -n 65535

Performance

Based on benchmark tests (200 connections, 100K requests):

Backend	RPS	Avg Latency	P95	P99
uSockets	~22,000	8.75ms	16.66ms	25.73ms
picoev	~15,000	13.36ms	18.89ms	31.66ms

uSockets provides ~50% higher throughput under high concurrency.

Usage

import meiseayoung.hono

fn main() {
    mut app := hono.Hono.new()
    
    app.get('/', fn (mut c hono.Context) http.Response {
        return c.text('Hello from uSockets!')
    })
    
    // Use uSockets backend
    app.listen_usockets(3000)
}

Build Command

v -enable-globals -cc gcc -ldflags "-ldbghelp" your_app.v -o app.exe

Required flags:

-enable-globals - Required for uSockets global state
-cc gcc - Use GCC compiler (MinGW-w64 on Windows)
-ldflags "-ldbghelp" - Fix Windows linking (Windows only)

Prerequisites (Windows)

GCC (MinGW-w64)

scoop install mingw
# or
choco install mingw

V Compiler (0.4.x or later)
```
scoop install vlang
```

Directory Structure

usockets/
├── include/           # Header files
│   ├── libusockets.h  # uSockets API
│   ├── uv.h           # libuv API
│   └── uv/            # libuv headers
├── lib/               # Pre-compiled libraries
│   ├── libusockets_full.a  # uSockets + libuv (main)
│   ├── libuv.a             # libuv static lib
│   └── ...
└── usockets.v         # V bindings

Configuration

// Custom configuration
app.listen_usockets_with_config(meiseayoung.hono.UsocketsConfig{
    port: 8080
    host: '0.0.0.0'
    keepalive_timeout: 30
    max_keepalive_req: 10000
})

Notes

On Windows, uSockets and picoev have similar performance
On Linux, uSockets may have greater advantages due to epoll optimization
uSockets excels under high concurrency (200+ connections)

2.6 KiB Raw Blame History