config llm proxy
LLM Proxy configuration.
config llm proxy
Description: LLM Proxy configuration.
set name {string}
set status [enable|disable]
set protocol {option1}, {option2}, ...
set ipv6-status [enable|disable]
set incoming-http-port {integer}
set incoming-https-port {integer}
set interface <name1>, <name2>, ...
set incoming-ip {ipv4-address-any}
set incoming-ip6 {ipv6-address}
set hostname {string}
set ssl-certificate <name1>, <name2>, ...
set ssl-min-version [ssl-3.0|tls-1.0|...]
set ssl-max-version [ssl-3.0|tls-1.0|...]
set srv-pool-ttl {integer}
set srv-pool-max-request {integer}
set srv-pool-max-concurrent-request {integer}
end
config llm proxy
|
Parameter |
Description |
Type |
Size |
Default |
||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
name |
LLM Proxy name. |
string |
Maximum length: 35 |
|
||||||||||||
|
status |
Enable/disable the LLM proxy. |
option |
- |
disable |
||||||||||||
|
|
|
|||||||||||||||
|
protocol |
Supported protocols. |
option |
- |
https |
||||||||||||
|
|
|
|||||||||||||||
|
ipv6-status |
Enable/disable the LLM proxy on IPv6. |
option |
- |
disable |
||||||||||||
|
|
|
|||||||||||||||
|
incoming-http-port |
LLM Proxy HTTP incoming port. |
integer |
Minimum value: 1 Maximum value: 65535 |
8098 |
||||||||||||
|
incoming-https-port |
LLM Proxy HTTPS incoming port. |
integer |
Minimum value: 1 Maximum value: 65535 |
8099 |
||||||||||||
|
interface |
Name of the interfaces to use LLM Proxy. Interface list. |
string |
Maximum length: 79 |
|
||||||||||||
|
incoming-ip |
LLM Proxy incoming IP. |
ipv4-address-any |
Not Specified |
0.0.0.0 |
||||||||||||
|
incoming-ip6 |
LLM Proxy incoming IPv6. |
ipv6-address |
Not Specified |
:: |
||||||||||||
|
hostname |
hostname. |
string |
Maximum length: 255 |
|
||||||||||||
|
ssl-certificate |
Name of the certificates to use for SSL handshake. Certificate list. |
string |
Maximum length: 79 |
|
||||||||||||
|
ssl-min-version |
Lowest SSL/TLS version acceptable from a client. |
option |
- |
tls-1.1 |
||||||||||||
|
|
|
|||||||||||||||
|
ssl-max-version |
Highest SSL/TLS version acceptable from a client. |
option |
- |
tls-1.3 |
||||||||||||
|
|
|
|||||||||||||||
|
srv-pool-ttl |
Time-to-live for idle connections to servers. |
integer |
Minimum value: 0 Maximum value: 2147483647 |
30 |
||||||||||||
|
srv-pool-max-request |
Maximum number of requests that a server can handle before disconnecting sessions (default = unlimited). |
integer |
Minimum value: 0 Maximum value: 2147483647 |
0 |
||||||||||||
|
srv-pool-max-concurrent-request |
Maximum number of concurrent requests that a server can handle (default = unlimited). |
integer |
Minimum value: 0 Maximum value: 2147483647 |
0 |
||||||||||||