Models#

Note

Anaconda AI Navigator is in beta testing. This documentation is currently under construction.

Browsing models#

Anaconda hosts a repository of open-source and partner models that you can explore and use to test and develop your applications. Models provided during the beta are intended for testing only, not for commercial use.

Use the search function to locate models by name.

Contact us if you are interested in specific models or use cases.

Filtering models#

You can apply filters to help you efficiently locate the models that you want to use.

To apply a filter:

  1. From the Models page, click Filter.

  2. Open a filter dropdown and select a filter option.

  3. Repeat as necessary to filter down to only the models you want.

Model filters:

  • Purpose - Currently, the only field in this category is text generation. Future releases will expand on this category, allowing you to filter models by the specific types of tasks they excel at.

  • Language - Filter models by which spoken languages they can understand.

  • License - Filter models based on their usage permissions and restrictions, such as permissive, non-commercial, or specific distribution terms.

Downloading models#

Anaconda provides a variety of LLM models for you to work with, constructed at various levels of quantization.

To download a model:

  1. Select Models from the left-hand navigation.

  2. Locate a model you want to download.

  3. Open the Quantization Method dropdown and select a file quantization level, then click Download to Use to download the model locally.

    Note

    Models that show a Downloaded tag on their tile indicate that you have downloaded at least one file for that model.

Managing downloads#

Pause a download by clicking Pause on the model’s tile, or by navigating to the Downloaded Models page and clicking the icon beside the download progress bar.

Note

Downloads automatically pause if you exit the application for any reason.

Resume a download by clicking Resume on the model’s tile, or by navigating to the Downloaded Models page and clicking the icon beside the download progress bar.

Cancel a download by clicking Cancel on the model’s tile, or by navigating to the Downloaded Models page and clicking the icon beside the download progress bar.

Viewing model details#

Click on a model’s tile to view its details. From here, you can read a brief description of the model and see important information about it, such as its file size at each quantization level, parameter count, the quality you can expect from the model’s output, how much resource usage can be expected by the model, and its intended purpose (for use in either development or production).

Tip

  • Hover over a tooltip icon to view detailed information about the various aspects of a model.

  • Click Learn more to visit the Huggingface webpage of the organization that built the model.

On this page