IBM watsonx.ai is a full service enterprise AI toolkit that you can use to build and deploy end-to-end AI solutions. Starting with the Cloud Pak for Data 5.0.1 release, you can now install a lightweight engine to run watsonx.ai inference in any environment with a reduced footprint and embed a subset of watsonx.ai features into your gen AI applications.
Benefits
Use the watsonx.ai lightweight engine to embed watsonx.ai into other software products and gain the following benefits:
- Access a variety of fit-for-purpose foundation models including open-source, proprietary, and custom foundation models.
- Leverage enterprise-grade APIs for a consistent developer experience across both full service and lightweight engine modes.
- Reduce the total footprint and compute required while delivering gen AI inferencing capabilities at enterprise scale.
Features
The watsonx.ai lightweight engine includes the following components:
- Generative AI APIs for inferencing foundation models and vectorizing text programmatically.
- AI guardrails for filtering personally-identifiable information and hate, abuse, and profanity.
- Red Hat® OpenShift AI platform layer that supports hosting and inferencing AI models.
- Cloud Pak for Data platform, which provides capabilities such as a command-line installer, auditing, licensing, logging, and more.
The following diagram shows the components that comprise the watsonx.ai lightweight engine versus the full watsonx.ai service.
Installing the watsonx.ai lightweight engine
You can install the watsonx.ai lightweight engine to host and inference AI models from an on-premises installation with a smaller footprint than the full watsonx.ai service.
For more information about the features that are supported by the two installation modes, see Choosing an IBM watsonx.ai installation mode in the Cloud Pak for Data product documentation.
The steps that you follow to install the watsonx.ai lightweight engine are the same as the full service installation, with one exception. You must specify a new installation option to select the lightweight engine mode in a file named install-options.yml in the work directory as follows:
########################################################################
# watsonx.ai parameters
########################################################################
custom_spec:
watsonx_ai:
lite_install: true
For details about how to install the IBM watsonx.ai lightweight engine, see Installing IBM watsonx.ai in the Cloud Pak for Data product documentation.
To learn more about watsonx.ai, and the services and foundation models it provides, visit the IBM watsonx.ai product page or start a free trial today.
#data-highlights-home
#Highlights
#Highlights-home