For the complete documentation index, see llms.txt. This page is also available as Markdown.

Hardware Specifications

For customers wishing to provide their own hardware we recommend the following minimum specifications:

  • Server-level system to run Rocky-based Linux (we provide an installer for the OS)

  • Nvidia RTX A-series GPU or RTX Ada GPU

  • Enterprise level high endurance SSD for cache

Last updated