diff --git a/.env b/.env index 9e5dbd79ee4f..e92f7f3b774e 100644 --- a/.env +++ b/.env @@ -82,6 +82,15 @@ # Enable to allow p2p mode # LOCALAI_P2P=true +# Enable to use federated mode +# LOCALAI_FEDERATED=true + +# Enable to start federation server +# FEDERATED_SERVER=true + +# Define to use federation token +# TOKEN="" + ### Watchdog settings ### # Enables watchdog to kill backends that are inactive for too much time diff --git a/docs/content/docs/features/distributed_inferencing.md b/docs/content/docs/features/distributed_inferencing.md index 254de0925dc7..71d29f392619 100644 --- a/docs/content/docs/features/distributed_inferencing.md +++ b/docs/content/docs/features/distributed_inferencing.md @@ -129,6 +129,9 @@ There are options that can be tweaked or parameters that can be set using enviro | Environment Variable | Description | |----------------------|-------------| +| **LOCALAI_P2P** | Set to "true" to enable p2p | +| **LOCALAI_FEDERATED** | Set to "true" to enable federated mode | +| **FEDERATED_SERVER** | Set to "true" to enable federated server | | **LOCALAI_P2P_DISABLE_DHT** | Set to "true" to disable DHT and enable p2p layer to be local only (mDNS) | | **LOCALAI_P2P_ENABLE_LIMITS** | Set to "true" to enable connection limits and resources management (useful when running with poor connectivity or want to limit resources consumption) | | **LOCALAI_P2P_LISTEN_MADDRS** | Set to comma separated list of multiaddresses to override default libp2p 0.0.0.0 multiaddresses |