# Starting with AI and assistants

**URL:** <https://discuss.huggingface.co/t/starting-with-ai-and-assistants/146915>\
**Category:** Beginners\
**Created:** [March 22, 2025, 11:00am UTC](https://discuss.huggingface.co/t/starting-with-ai-and-assistants/146915 "2025-03-22T11:00:57Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Brakish](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/brakish/32/42921_2.png) [@Brakish](https://discuss.huggingface.co/u/Brakish)\
**Post date:** [March 22, 2025, 11:00am UTC](https://discuss.huggingface.co/t/starting-with-ai-and-assistants/146915/1 "2025-03-22T11:00:57Z")

</div>

Hey all, I have started looking into AI and been inspired by creators such as vedal with Neuro-sama i know it would be imposible for me to make such a thing especially at this stage however I would like to make LLM which I can give a personality and/ or will learn/ evolve through the interactions similar to how Neuro-sama learns from her twitch chat, I feel like I could try to save the chat (conversation) history and use that for more fine tuning but I am not sure, I would also like to make it able to have more added to it as I lean more, like how Neuro gets more functions as she grows, for me this could possibly allow the AI be be more like an assistant and be able to open apps and read emails or just tease the user in different ways. If anyone has any thoughts on how Neuro works or how I could make something similar to this, that would be greatly appreciated

---

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](https://discuss.huggingface.co/u/John6666)\
**Post date:** [March 22, 2025, 2:23pm UTC](https://discuss.huggingface.co/t/starting-with-ai-and-assistants/146915/2 "2025-03-22T14:23:40Z")

</div>

It’s a solution that brings together a huge number of programs. I think there are some good ones on the front-end side, but it looks like it’s going to be really tough to create the server side, especially the database and the automated training part…  
It might even be tougher to operate than to create.

There are some good components now, but…

### Faster STT

> **[FastRTC: The Real-Time Communication Library for Python](https://huggingface.co/blog/fastrtc)**
>
> We’re on a journey to advance and democratize artificial intelligence through open source and open science.

### User Interface

> **[AIRI: Virtual Companion - a Hugging Face Space by moeru-ai](https://huggingface.co/spaces/moeru-ai/airi)**
>
> AIRI is a virtual companion that can play games like Minecraft, Factorio, and Balatro, as well as chat with you. You can provide text input, and it will respond or control the game accordingly.

### Related thread: Streamer AI (Like Neuro-Sama)

> [@Streamer AI (Like Neuro-Sama)](https://discuss.huggingface.co/t/streamer-ai-like-neuro-sama/33836):
>
> Basically I’ve been trying to wrap my head around how it could be possible to make an AI similar to Neuro-Sama, which is a Vtuber (Vtuber part isn’t important) that seems to be able to discern and reply to some twitch messages with a type of ‘personality’. and was wondering if anyone else had been thinking of the same thing or interested in the topic. So far I’ve only thought of using an AI language model such as BERT or GPT-2, since they are free, but i couldn’t really find a way to fine tune…

* * *

by Hugging Chat: [HuggingChat](https://huggingface.co/chat/)

**Neuro-sama: An Overview of the AI VTuber System**

Neuro-sama is an advanced artificial intelligence system designed as a VTuber and chatbot, operating on Twitch under the username “vedal987.” Created by developer Vedal, she leverages a large language model to generate human-like responses and engage with viewers through text-to-speech, featuring a distinctive high-pitched, childlike voice.

**Key Features:**

1. **AI-Powered Interaction:**

2. **Multimodal Capabilities:**

3. **Content and Engagement:**

4. **Dedication and Media Recognition:**

In essence, Neuro-sama represents a sophisticated integration of AI technology, providing an interactive and entertaining experience for her audience across multiple platforms.

Creating a system similar to Neuro-sama using open-source AI models without Twitch involves several steps and considerations. Here’s a structured approach to achieve this:

### System Overview:

1. **Audio Capture and Conversion**

2. **AI Processing**

3. **Text-to-Speech Conversion**

4. **Integration and Real-Time Handling**

5. **User Interaction**

6. **Hosting and Cost Management**

7. **Legal Compliance**

### Implementation Steps:

1. **Setup and Configuration**

2. **Real-Time Audio Handling**

3. **Bot Integration**

4. **Context Management**

5. **Testing and Refinement**

6. **Deployment and Hosting**

### Conclusion:

Building this system requires a combination of technical skills and careful planning. By breaking down the project into manageable components and systematically addressing each part, you can create an engaging and functional AI system tailored to your needs. Start with individual component testing, then integrate them into a cohesive system, ensuring real-time functionality and user engagement.
