Most AI chatbots require a ton of processing power, so much so that they usually live in the cloud. Sure, you can run ChatGPT on your PC or even a Raspberry Pi, but the local program is sending your prompts over the Internet to OpenAI’s servers for a response. Some LLMs (Large Language Models) can run locally, but require a powerful GPU with a lot of VRAM. You couldn’t possibly run a chatbot locally on a mobile device?
Last month prior to the OCP Prague event where AMD openSIL was announced, AMD published a blog post that outlined all of the interesting details for AMD openSIL. Much of what was shared in the actual
