|
Canada-0-FreightForwarding Azienda Directories
|
Azienda News:
- ollama - Reddit
r ollama How good is Ollama on Windows? I have a 4070Ti 16GB card, Ryzen 5 5600X, 32GB RAM I want to run Stable Diffusion (already installed and working), Ollama with some 7B models, maybe a little heavier if possible, and Open WebUI I don't want to have to rely on WSL because it's difficult to expose that to the rest of my network I've been searching for guides, but they all seem to either
- r ollama on Reddit: HOW TO GET UNCENSORED MODELS LIKE DOLPHIN-MIXTRAL . . .
Next, type this in terminal: ollama create dolph -f modelfile dolphin The dolph is the custom name of the new model You can rename this to whatever you want Once you hit enter, it will start pulling the model specified in the FROM line from ollama's library and transfer over the model layer data to the new custom model
- How to Uninstall models? : r ollama - Reddit
That's really the worst To get rid of the model I needed on install Ollama again and then run "ollama rm llama2" It should be transparent where it installs - so I can remove it later Meh
- Local Ollama Text to Speech? : r robotics - Reddit
Yes, I was able to run it on a RPi Ollama works great Mistral, and some of the smaller models work Llava takes a bit of time, but works For text to speech, you’ll have to run an API from eleveabs for example I haven’t found a fast text to speech, speech to text that’s fully open source yet If you find one, please keep us in the loop
- Freeing VRAM with ollama : r LocalLLaMA - Reddit
Hi chaps, I'm loving ollama, but am curious if theres anyway to free unload a model after it has been loaded - otherwise I'm stuck in a state with 90% of my VRAM utilized Do I need to shutdown the systemd service? Would be nice if there was a way to do it from the CLI
- Request for Stop command for Ollama Server : r ollama - Reddit
Ok so ollama doesn't Have a stop or exit command We have to manually kill the process And this is not very useful especially because the server respawns immediately So there should be a stop command as well Edit: yes I know and use these commands But these are all system commands which vary from OS to OS I am talking about a single command
- Critical RCE Vulnerability Discovered in Ollama AI . . . - Reddit
And now, against the background of the now known ollama's docker container security vulnerability, you can imagine what it means when this container generously presents its private SSH keys to the world, which are only used to download models from the (closed source) Ollama platform in a supposedly convenient way
- How safe are models from ollama? : r ollama - Reddit
Models in Ollama do not contain any "code" These are just mathematical weights Like any software, Ollama will have vulnerabilities that a bad actor can exploit So, deploy Ollama in a safe manner E g : Deploy in isolated VM Hardware Deploy via docker compose , limit access to local network Keep OS Docker Ollama updated
- Whats the best 7b model on Ollama right now? [Feb 2024] : r . . . - Reddit
I think this question should be discussed every month If applicable, please separate out your best models by use case Specifically Ollama because that's the easiest way to build with LLMs right now Best overall general use Best for coding Best for RAG Best conversational (chatbot applications) Best uncensored
|
|