NOVA DEEP KNOWLEDGE Desktop Multi-Agent AI
by tomspeechnz in Circuits > Computers
246 Views, 2 Favorites, 0 Comments
NOVA DEEP KNOWLEDGE Desktop Multi-Agent AI
This is like having ChatGPT running on your Desktop of your Win11 PC!! It will do most things that big AIs can do (some the presentation is better, others it cannot match like creating diagrams). The point is to have your own AI on your PC which can then be used for electronic projects like running your lights of your house, videos,music or just doing your maths or computing homework! This is not a Chatbot however, it is a serious AI that can be used for serious research purposes. It will run with local Ollama models you can download or you can use powerful AI models from openrouter such as Claude. When using local Ollama models you have complete privacy and it will run off-grid but it will run slower and you will have less brain power than the online models. Though this all depends on the size of your graphics card on your PC. What it can't do at present is Video input but that isn't too difficult to add later.
Download Python 3.10 or Similar
Assuming you are new to this you probably don't have the Python programming language on your PC so you'd better first download it. Use version 3.10 or slightly above, don't take the latest version because latest isn't always best until all bugs are ironed out! Download directly from https://www.python.org/downloads/windows/ and get the 64 bit version as most modern PCs are 64 bit unless you know otherwise about your machines. IMPORTANT: Make sure as in the picture that you tick the Add python to path box. Otherwise you will avoid later pain! See the picture. THEN check that it is installed after a reboot by going into the command prompt i.e CMD and typing python. It should respond a bit like this depending on your PC paths:
C:\Users\OEM>python
Python 3.10.11 (tags/v3.10.11:7d4cc5a, Apr 5 2023, 00:38:17) [MSC v.1929 64 bit (AMD64)] on win32
Type "help", "copyright", "credits" or "license" for more information.
>>>
If it doesn't then you haven't got the path installed and the rest won't work. You will have to manually install the path. Also don't be tempted to download the Windows version of Python from the Windows store as that won't work on this project either.
Download Git Program
Go to the link https://git-scm.com/install/ and download Git (assuming you don't already have it for other projects). This will enable you to download the project files from git (ie an online repository where I stashed the code!)
Download Visual Studio Desktop Tools 2022
We need the Visual Studio Desktop tools. We don't need the whole Visual studio as in the image. The link is Tools for visual studio 2022 (not 2026 as in the image)
https://aka.ms/vs/17/release/vs_BuildTools.exe
Install the above link only, we DO NOT need the whole of Visual Studio. This is needed for python. The pip command in python downloads the libraries you need but it may not have the right binary version for your setup so it is used to compile the 'wheels' i.e. source. You could run without it but there is a chance it may need to do some compiling. This is all done automatically invisible to the user so best to avoid trouble later.
Download Free Version of Pycharm
Download Pycharm (the free version, we don't need the bought full version). Download from https://www.jetbrains.com/pycharm/download/?section=windows . This is the final preparation step, the rest is just installing the actual software.
Test PyCharm
Navigate to where I put the main software: tommoirnz/NOVAKnowledge_5 and have a quick look, we will use this link in Pycharm, assuming you have installed it as the previous step.
First check Pycharm by running it and selecting File--> new project. Tick create a welcome script and then click the blue create button and your test program PythonProject1 will appear. Pycharm creates a test program
(you don't need to type this). Press the green Run button at the top and Hi, PyCharm should appear in the command window at the bottom.
C:\Users\OEM\PycharmProjects\PythonProject1\.venv\Scripts\python.exe C:\Users\OEM\PycharmProjects\PythonProject1\main.py
Hi, PyCharm
Process finished with exit code 0
You are now half way there. We now have to download the git. Go to File -->close project to get out of your test program.
Clone the AI Repository to Your PyCharm Directory
Once you have closed the previous test project you will see the above appear on PyCharm and the top right button which says Clone Repository must then be pressed.
Make Sure You Run in a Virtual Environment .venv
Type the URL in as shown tommoirnz/NOVAKnowledge_5 and press the blue clone button. All the files will appear but don't be tempted to run just yet. The reason is as follows. PyCharm can sort of run like that but it needs a virtual environment otherwise all sorts of bad things happen!! You know there is a virtual environment when a file right at the top says .venv. If it is not there then don't run. If it does appear then you will only need to setup the Python interpreter in the next step.
Select the Python Interpreter
On PyCharm select File-->settings--->Python then select the blue Interpreter link. When clicked another menu appears. Select Python 3.10 or the version you downloaded. Also check the .venv file is top left in the program listings of the code. If it's there you can run otherwise go back to File--> settings and go to this link for further instructions. Configure a virtualenv environment | PyCharm Documentation
This can be fiddly sometimes but once set up it is easy to proceed.
Run the Program MAIN_RUNME.py
from the list of files on the left of PyCharm select MAIN_RUNME.py and the program will run! However it won't run properly until you edit a few files.
Purchase Openrouter Key or Download Free Ollama Models
Go to OpenRouter and buy some time on your chosen AI. I use Claude 4.6. If you click on config.json you will see
You see that is my default "Claude Opus 4.6", "id": "anthropic/claude-opus-4-6". You can select any one you like from the dropdown menu when NOVA runs. But unless you have installed Ollama on your pc and downloaded the models to disk (by the pull command) you will be running off the Cloud and openrouter as default. You will need a key from https://openrouter.ai which you must buy credits. (if you run local models of course it costs you nothing). For local models first install https://ollama.com/download for Windows. Then in PyCharm on the command window pull the model you want. For example Ollama pull <model-name>
Examples:
Llama 3.2
3B
2.0GB
pull llama3.2
Llama 3.2
1B
1.3GB
pull llama3.2:1b
Gemma 3
4B
3.3GB
pull gemma3
DeepSeek-R1
7B
4.7GB
pull deepseek-r1
Phi-4
14B
9.1GB
pull phi4
Mistral
7B
4.1GB
pull mistral
Make sure your graphics card is at least 8GB or more video RAM. I use 16GB VRAM. The more the better!
For best results and no worry over video RAM use openrouter Cloud models.
Get a Free Brave Api Search Key
Go to https://brave.com/search/api and get a Free Brave api key. Does 2000 searches per month so you can use the web search. beyond that amount it is very cheap for more searches. Obtain the key once purchased.
Now put both keys in the .env file like this, replacing xxxx and yyy with your respective keys.
Then edit the nova_location.json file in the built in editor in Pycharm
You don't need your city information as NOVA gets that from your IP address but for say local weather it needs your suburb or local searches etc., that way it knows your geo location precisely.
Edit music.json
if you have an mp3 directory or video collection put that there.
Run Certificate_Generate.py
Look for Certificate_Generate.py , select it and run it ONCE ONLY!! It will create the certificates for https:// so you can get the AI on another remote machine in your house or Tablet. Otherwise the microphone will not work.
Run MAIN_RUNME.py
Then the AI will start. extend the main window further ie stretch it vertically from the bottom right and you will see the picture I attached. Tick the box mobile FIRST (or it won't work), then start the server on the PC and open the window and it opens at the IP address shown. You can they use this same address for the URL of a mobile device. Advice to use Chrome or Firefox as Edge may neat extra security measures.
Speech Recognition
Speech recognition runs off your default microphone device on your pc and uses faster-whisper. To take advantage of this make sure you have CUDA installed otherwise it will default to the CPU and the speech recognition will take longer. For NVIDIA cards only, you download CUDA from CUDA Toolkit 13.2 Downloads | NVIDIA Developer . Note that OLLAMA does not need CUDA only the speech recognition so if you don't have a fast video card you can still run with slower speech recognition or just type!
Some DEMOS
Running on a PC
NOVA Knowledge Agentic AI, Web Interface Demos.
Running on a Tablet
NOVA Knowledge Agentic AI, Tablet Version Demo
NOVA wants to live:
NOVA DREAMS: It's life Jim but not as we know it. Seems NOVA AI wants to live.
NOVA with added Emotions
As it requested I added feelings and this was the result.
This project is open source so you can contribute to the code, if you so wish. Acknowledge the source.
Upgrade to Version 3.0.0
I have made some improvements on the previous version on file handling and performed unit tests. Try it instead. tommoirnz/NOVAKnowledge_3: Multi-Agent AI that runs on Ollama or cloud services.
USS NOVA Star Trek Tribute Style
For a spot of fun, try the USS Nova Star-Trek tribute style instead. Replace step 7 with this tommoirnz/USSNOVAStarfleet_1: Star-Trek inspired Ai multi-agent computer. . It responds like the ships computer of a Star-Trek episode. Uses star-dates etc. In fact it is very close to something very futuristic and you have full control as it's on your own PC, so you can change the source. Use it to write your own software for instance, to play movies or mp3 files held locally on your PC.