|
Canada-0-LEATHER Azienda Directories
|
Azienda News:
- ollama - Reddit
r ollama How good is Ollama on Windows? I have a 4070Ti 16GB card, Ryzen 5 5600X, 32GB RAM I want to run Stable Diffusion (already installed and working), Ollama with some 7B models, maybe a little heavier if possible, and Open WebUI I don't want to have to rely on WSL because it's difficult to expose that to the rest of my network I've been searching for guides, but they all seem to either
- Ollama GPU Support : r ollama - Reddit
I've just installed Ollama in my system and chatted with it a little Unfortunately, the response time is very slow even for lightweight models like…
- Request for Stop command for Ollama Server : r ollama - Reddit
Ok so ollama doesn't Have a stop or exit command We have to manually kill the process And this is not very useful especially because the server respawns immediately So there should be a stop command as well Edit: yes I know and use these commands But these are all system commands which vary from OS to OS I am talking about a single command
- Local Ollama Text to Speech? : r robotics - Reddit
Yes, I was able to run it on a RPi Ollama works great Mistral, and some of the smaller models work Llava takes a bit of time, but works For text to speech, you’ll have to run an API from eleveabs for example I haven’t found a fast text to speech, speech to text that’s fully open source yet If you find one, please keep us in the loop
- Ollama not using GPUs : r ollama - Reddit
Don't know Debian, but in arch, there are two packages, "ollama" which only runs cpu, and "ollama-cuda" Maybe the package you're using doesn't have cuda enabled, even if you have cuda installed Check if there's a ollama-cuda package If not, you might have to compile it with the cuda flags I couldn't help you with that
- Ollama is making entry into the LLM world so simple that even . . . - Reddit
I took time to write this post to thank ollama ai for making entry into the world of LLMs this simple for non techies like me Edit: A lot of kind users have pointed out that it is unsafe to execute the bash file to install Ollama So, I recommend using the manual method to install it on your Linux machine
- Training a model with my own data : r LocalLLaMA - Reddit
I'm using ollama to run my models I want to use the mistral model, but create a lora to act as an assistant that primarily references data I've supplied during training This data will include things like test procedures, diagnostics help, and general process flows for what to do in different scenarios
- How to manually install a model? : r ollama - Reddit
I'm currently downloading Mixtral 8x22b via torrent Until now, I've always ran ollama run somemodel:xb (or pull) So once those >200GB of glorious…
- r ollama on Reddit: HOW TO GET UNCENSORED MODELS LIKE DOLPHIN-MIXTRAL . . .
Next, type this in terminal: ollama create dolph -f modelfile dolphin The dolph is the custom name of the new model You can rename this to whatever you want Once you hit enter, it will start pulling the model specified in the FROM line from ollama's library and transfer over the model layer data to the new custom model
|
|