Open-source AI character chatbot built around small models

Aiko is an AI anime character chatbot with , vision, voice input and output, simple web search through , and 3D avatar animation. All models are under , so the system is designed to be light enough for a home PC. The current setup runs the models through llama.cpp servers on the Modal platform.

The code is free and open source. The current codebase is tied to , a Gradio interface, and specific Modal endpoints, so it needs changes before it can run on a normal local machine. The project was built partly to get high-quality in both English and Japanese for language learning.

Its reuses work from an earlier autonomous robot project submitted to NVIDIA.

Key points

  • Aiko combines memory, vision, voice, web search, and 3D avatar animation.
  • All models are under , which keeps the hardware target modest.
  • The live setup currently uses llama.cpp servers on Modal.
  • The source code is open source and can be modified freely.
  • Running it on a Mac mini would require replacing the , Gradio, and Modal-specific parts.
Read original