I have been using WEB LLM https://www.drupal.org/project/offline_ai to run A.I. tools locally in browser. I like it as it keeps my data local to me and does not need to use external A.P.I. to get inference.
The Drupal module integrates the Web LLM code API into the site so you can interact with various AI module and create custom modules to interact with the api that is exposed.
WebLLM AI brings powerful artificial intelligence capabilities directly to your Drupal site without requiring external API keys or cloud services. This module integrates WebLLM technology to run large language models entirely in users' browsers using WebGPU, providing private, offline AI functionality for content generation, text processing, and interactive AI features while keeping all data completely local.
WEB LLM AI is a very useful tool.
I have been using WEB LLM https://www.drupal.org/project/offline_ai to run A.I. tools locally in browser. I like it as it keeps my data local to me and does not need to use external A.P.I. to get inference.
See the live demo on this site at https://drupletraining.com/webllm-ai/demo
This Drupal module is based on the Web LLM system here https://webllm.mlc.ai/
The Drupal module integrates the Web LLM code API into the site so you can interact with various AI module and create custom modules to interact with the api that is exposed.