Fortinet white logo
Fortinet white logo

CLI Reference

config llm proxy

config llm proxy

This command is available for model(s): FortiGate 1000D, FortiGate 1000F, FortiGate 1001F, FortiGate 100F, FortiGate 101F Gen2, FortiGate 1100E, FortiGate 1101E, FortiGate 120G, FortiGate 121G, FortiGate 1800F, FortiGate 1801F, FortiGate 2000E, FortiGate 200E, FortiGate 200F, FortiGate 200G, FortiGate 201E, FortiGate 201F, FortiGate 201G, FortiGate 2200E, FortiGate 2201E, FortiGate 2500E, FortiGate 2600F, FortiGate 2601F, FortiGate 3000F, FortiGate 3001F, FortiGate 300E, FortiGate 301E, FortiGate 30G, FortiGate 31G, FortiGate 3200F, FortiGate 3201F Gen2, FortiGate 3300E, FortiGate 3301E, FortiGate 3400E, FortiGate 3401E, FortiGate 3500F Gen2, FortiGate 3501F Gen2, FortiGate 3600E, FortiGate 3601E, FortiGate 3700F, FortiGate 3701F, FortiGate 3960E, FortiGate 3980E, FortiGate 400E Bypass, FortiGate 400E, FortiGate 400F, FortiGate 401E, FortiGate 401F, FortiGate 40F 3G4G, FortiGate 40F, FortiGate 4200F, FortiGate 4201F Gen2, FortiGate 4400F, FortiGate 4401F Gen2, FortiGate 4800F, FortiGate 4801F, FortiGate 500E, FortiGate 501E, FortiGate 50G 5G, FortiGate 50G DSL, FortiGate 50G SFP-POE, FortiGate 50G SFP, FortiGate 50G, FortiGate 51G 5G, FortiGate 51G SFP-POE, FortiGate 51G, FortiGate 600E, FortiGate 600F, FortiGate 601E, FortiGate 601F, FortiGate 60F, FortiGate 61F, FortiGate 70F, FortiGate 70G-POE, FortiGate 70G, FortiGate 71F, FortiGate 71G-POE, FortiGate 71G, FortiGate 800D, FortiGate 80F Bypass, FortiGate 80F DSL, FortiGate 80F Gen2, FortiGate 80F-POE, FortiGate 81F Gen2, FortiGate 81F-POE, FortiGate 900D, FortiGate 900G, FortiGate 901G, FortiGate 90G Gen2, FortiGate 90G, FortiGate 91G Gen2, FortiGate 91G, FortiGateRugged 50G 5G, FortiGateRugged 60F 3G4G, FortiGateRugged 60F Gen2, FortiGateRugged 70F 3G4G, FortiGateRugged 70F, FortiGateRugged 70G 5G Dual, FortiGateRugged 70G, FortiWiFi 30G, FortiWiFi 31G, FortiWiFi 40F 3G4G, FortiWiFi 40F, FortiWiFi 50G 5G, FortiWiFi 50G DSL, FortiWiFi 50G SFP, FortiWiFi 50G, FortiWiFi 51G, FortiWiFi 60F, FortiWiFi 61F, FortiWiFi 70G-POE, FortiWiFi 70G, FortiWiFi 71G, FortiWiFi 80F 2R 3G4G DSL, FortiWiFi 80F 2R, FortiWiFi 81F 2R 3G4G DSL, FortiWiFi 81F 2R 3G4G-POE, FortiWiFi 81F 2R-POE, FortiWiFi 81F 2R.

It is not available for: FortiGate-VM64 Aliyun, FortiGate-VM64 AWS, FortiGate-VM64 Azure, FortiGate-VM64 GCP, FortiGate-VM64 OPC, FortiGate-VM64.

Configure LLM Proxy.

config llm proxy
    Description: Configure LLM Proxy.
    set hostname {string}
    set incoming-http-port {integer}
    set incoming-https-port {integer}
    set incoming-ip {ipv4-address-any}
    set incoming-ip6 {ipv6-address}
    set interface <name1>, <name2>, ...
    set ipv6-status [enable|disable]
    set name {string}
    set protocol {option1}, {option2}, ...
    set srv-pool-max-concurrent-request {integer}
    set srv-pool-max-request {integer}
    set srv-pool-ttl {integer}
    set ssl-certificate <name1>, <name2>, ...
    set ssl-max-version [ssl-3.0|tls-1.0|...]
    set ssl-min-version [ssl-3.0|tls-1.0|...]
    set status [enable|disable]
end

config llm proxy

Parameter

Description

Type

Size

Default

hostname

hostname.

string

Maximum length: 255

incoming-http-port

LLM Proxy HTTP incoming port.

integer

Minimum value: 1 Maximum value: 65535

8098

incoming-https-port

LLM Proxy HTTPS incoming port.

integer

Minimum value: 1 Maximum value: 65535

8099

incoming-ip

LLM Proxy incoming IP.

ipv4-address-any

Not Specified

0.0.0.0

incoming-ip6

LLM Proxy incoming IPv6.

ipv6-address

Not Specified

::

interface <name>

Name of the interfaces to use LLM Proxy.

Interface list.

string

Maximum length: 79

ipv6-status

Enable/disable the LLM proxy on IPv6.

option

-

disable

Option

Description

enable

Enable the LLM proxy on IPv6.

disable

Disable the LLM proxy on IPv6.

name

LLM Proxy name.

string

Maximum length: 35

protocol

Supported protocols.

option

-

https

Option

Description

http

HTTP.

https

HTTPS.

srv-pool-max-concurrent-request

Maximum number of concurrent requests that a server can handle (default = unlimited).

integer

Minimum value: 0 Maximum value: 2147483647

0

srv-pool-max-request

Maximum number of requests that a server can handle before disconnecting sessions (default = unlimited).

integer

Minimum value: 0 Maximum value: 2147483647

0

srv-pool-ttl

Time-to-live for idle connections to servers.

integer

Minimum value: 0 Maximum value: 2147483647

30

ssl-certificate <name>

Name of the certificates to use for SSL handshake.

Certificate list.

string

Maximum length: 79

ssl-max-version

Highest SSL/TLS version acceptable from a client.

option

-

tls-1.3

Option

Description

ssl-3.0

SSL 3.0.

tls-1.0

TLS 1.0.

tls-1.1

TLS 1.1.

tls-1.2

TLS 1.2.

tls-1.3

TLS 1.3.

ssl-min-version

Lowest SSL/TLS version acceptable from a client.

option

-

tls-1.1

Option

Description

ssl-3.0

SSL 3.0.

tls-1.0

TLS 1.0.

tls-1.1

TLS 1.1.

tls-1.2

TLS 1.2.

tls-1.3

TLS 1.3.

status

Enable/disable the LLM proxy.

option

-

disable

Option

Description

enable

Enable the LLM proxy.

disable

Disable the LLM proxy.

config llm proxy

config llm proxy

This command is available for model(s): FortiGate 1000D, FortiGate 1000F, FortiGate 1001F, FortiGate 100F, FortiGate 101F Gen2, FortiGate 1100E, FortiGate 1101E, FortiGate 120G, FortiGate 121G, FortiGate 1800F, FortiGate 1801F, FortiGate 2000E, FortiGate 200E, FortiGate 200F, FortiGate 200G, FortiGate 201E, FortiGate 201F, FortiGate 201G, FortiGate 2200E, FortiGate 2201E, FortiGate 2500E, FortiGate 2600F, FortiGate 2601F, FortiGate 3000F, FortiGate 3001F, FortiGate 300E, FortiGate 301E, FortiGate 30G, FortiGate 31G, FortiGate 3200F, FortiGate 3201F Gen2, FortiGate 3300E, FortiGate 3301E, FortiGate 3400E, FortiGate 3401E, FortiGate 3500F Gen2, FortiGate 3501F Gen2, FortiGate 3600E, FortiGate 3601E, FortiGate 3700F, FortiGate 3701F, FortiGate 3960E, FortiGate 3980E, FortiGate 400E Bypass, FortiGate 400E, FortiGate 400F, FortiGate 401E, FortiGate 401F, FortiGate 40F 3G4G, FortiGate 40F, FortiGate 4200F, FortiGate 4201F Gen2, FortiGate 4400F, FortiGate 4401F Gen2, FortiGate 4800F, FortiGate 4801F, FortiGate 500E, FortiGate 501E, FortiGate 50G 5G, FortiGate 50G DSL, FortiGate 50G SFP-POE, FortiGate 50G SFP, FortiGate 50G, FortiGate 51G 5G, FortiGate 51G SFP-POE, FortiGate 51G, FortiGate 600E, FortiGate 600F, FortiGate 601E, FortiGate 601F, FortiGate 60F, FortiGate 61F, FortiGate 70F, FortiGate 70G-POE, FortiGate 70G, FortiGate 71F, FortiGate 71G-POE, FortiGate 71G, FortiGate 800D, FortiGate 80F Bypass, FortiGate 80F DSL, FortiGate 80F Gen2, FortiGate 80F-POE, FortiGate 81F Gen2, FortiGate 81F-POE, FortiGate 900D, FortiGate 900G, FortiGate 901G, FortiGate 90G Gen2, FortiGate 90G, FortiGate 91G Gen2, FortiGate 91G, FortiGateRugged 50G 5G, FortiGateRugged 60F 3G4G, FortiGateRugged 60F Gen2, FortiGateRugged 70F 3G4G, FortiGateRugged 70F, FortiGateRugged 70G 5G Dual, FortiGateRugged 70G, FortiWiFi 30G, FortiWiFi 31G, FortiWiFi 40F 3G4G, FortiWiFi 40F, FortiWiFi 50G 5G, FortiWiFi 50G DSL, FortiWiFi 50G SFP, FortiWiFi 50G, FortiWiFi 51G, FortiWiFi 60F, FortiWiFi 61F, FortiWiFi 70G-POE, FortiWiFi 70G, FortiWiFi 71G, FortiWiFi 80F 2R 3G4G DSL, FortiWiFi 80F 2R, FortiWiFi 81F 2R 3G4G DSL, FortiWiFi 81F 2R 3G4G-POE, FortiWiFi 81F 2R-POE, FortiWiFi 81F 2R.

It is not available for: FortiGate-VM64 Aliyun, FortiGate-VM64 AWS, FortiGate-VM64 Azure, FortiGate-VM64 GCP, FortiGate-VM64 OPC, FortiGate-VM64.

Configure LLM Proxy.

config llm proxy
    Description: Configure LLM Proxy.
    set hostname {string}
    set incoming-http-port {integer}
    set incoming-https-port {integer}
    set incoming-ip {ipv4-address-any}
    set incoming-ip6 {ipv6-address}
    set interface <name1>, <name2>, ...
    set ipv6-status [enable|disable]
    set name {string}
    set protocol {option1}, {option2}, ...
    set srv-pool-max-concurrent-request {integer}
    set srv-pool-max-request {integer}
    set srv-pool-ttl {integer}
    set ssl-certificate <name1>, <name2>, ...
    set ssl-max-version [ssl-3.0|tls-1.0|...]
    set ssl-min-version [ssl-3.0|tls-1.0|...]
    set status [enable|disable]
end

config llm proxy

Parameter

Description

Type

Size

Default

hostname

hostname.

string

Maximum length: 255

incoming-http-port

LLM Proxy HTTP incoming port.

integer

Minimum value: 1 Maximum value: 65535

8098

incoming-https-port

LLM Proxy HTTPS incoming port.

integer

Minimum value: 1 Maximum value: 65535

8099

incoming-ip

LLM Proxy incoming IP.

ipv4-address-any

Not Specified

0.0.0.0

incoming-ip6

LLM Proxy incoming IPv6.

ipv6-address

Not Specified

::

interface <name>

Name of the interfaces to use LLM Proxy.

Interface list.

string

Maximum length: 79

ipv6-status

Enable/disable the LLM proxy on IPv6.

option

-

disable

Option

Description

enable

Enable the LLM proxy on IPv6.

disable

Disable the LLM proxy on IPv6.

name

LLM Proxy name.

string

Maximum length: 35

protocol

Supported protocols.

option

-

https

Option

Description

http

HTTP.

https

HTTPS.

srv-pool-max-concurrent-request

Maximum number of concurrent requests that a server can handle (default = unlimited).

integer

Minimum value: 0 Maximum value: 2147483647

0

srv-pool-max-request

Maximum number of requests that a server can handle before disconnecting sessions (default = unlimited).

integer

Minimum value: 0 Maximum value: 2147483647

0

srv-pool-ttl

Time-to-live for idle connections to servers.

integer

Minimum value: 0 Maximum value: 2147483647

30

ssl-certificate <name>

Name of the certificates to use for SSL handshake.

Certificate list.

string

Maximum length: 79

ssl-max-version

Highest SSL/TLS version acceptable from a client.

option

-

tls-1.3

Option

Description

ssl-3.0

SSL 3.0.

tls-1.0

TLS 1.0.

tls-1.1

TLS 1.1.

tls-1.2

TLS 1.2.

tls-1.3

TLS 1.3.

ssl-min-version

Lowest SSL/TLS version acceptable from a client.

option

-

tls-1.1

Option

Description

ssl-3.0

SSL 3.0.

tls-1.0

TLS 1.0.

tls-1.1

TLS 1.1.

tls-1.2

TLS 1.2.

tls-1.3

TLS 1.3.

status

Enable/disable the LLM proxy.

option

-

disable

Option

Description

enable

Enable the LLM proxy.

disable

Disable the LLM proxy.