47 min
119: Why So Many Llamas? Self-Hosted
-
- Technology
Alex rolls back a major server upgrade, and we have fun playing with local large language models.
Special Guest: Wes Payne.
Sponsored By:
Tailscale: Tailscale is a Zero config VPN. It installs on any device in minutes, manages firewall rules for you, and works from anywhere. Get 3 users and 100 devices for free. This Week in Bitcoin: A high-signal Bitcoin news podcast focused on analysis you'll find valuable.Support Self-Hosted
Links:
⚡ Grab Sats with Strike Around the World — Strike is a lightning-powered app that lets you quickly and cheaply grab sats in over 36 countries. 🎉 Boost with Fountain FM — Fountain 1.0 has a new UI, upgrades, and super simple Strike integration for easy Boosts.Training AI to Play Pokemon with Reinforcement Learning
Open WebUI — Open WebUI is an extensible, feature-rich, and user-friendly self-hosted WebUI for various LLM runners, supported LLM runners include Ollama and OpenAI-compatible APIs.Ollama — Get up and running with large language models, locally.Alex's Nix Nvidia Config
tlm — Local CLI Copilot, powered by CodeLLaMa.LM Studio - Discover, download, and run local LLMs — 🤖 - Run LLMs on your laptop, entirely offline
👾 - Use models through the in-app Chat UI or an OpenAI compatible local server
📂 - Download any compatible model files from HuggingFace 🤗 repositories
🔭 - Discover new & noteworthy LLMs in the app's home pageHugging Face — The Home of Machine Learning
🍔 Lunch at SCaLE 🍇 — Let's put an official time down on the calendar to get together. The Yardhouse has always been a solid go-to, so sit down and break bread with the Unplugged crew during the lunch break on Saturday!
Alex rolls back a major server upgrade, and we have fun playing with local large language models.
Special Guest: Wes Payne.
Sponsored By:
Tailscale: Tailscale is a Zero config VPN. It installs on any device in minutes, manages firewall rules for you, and works from anywhere. Get 3 users and 100 devices for free. This Week in Bitcoin: A high-signal Bitcoin news podcast focused on analysis you'll find valuable.Support Self-Hosted
Links:
⚡ Grab Sats with Strike Around the World — Strike is a lightning-powered app that lets you quickly and cheaply grab sats in over 36 countries. 🎉 Boost with Fountain FM — Fountain 1.0 has a new UI, upgrades, and super simple Strike integration for easy Boosts.Training AI to Play Pokemon with Reinforcement Learning
Open WebUI — Open WebUI is an extensible, feature-rich, and user-friendly self-hosted WebUI for various LLM runners, supported LLM runners include Ollama and OpenAI-compatible APIs.Ollama — Get up and running with large language models, locally.Alex's Nix Nvidia Config
tlm — Local CLI Copilot, powered by CodeLLaMa.LM Studio - Discover, download, and run local LLMs — 🤖 - Run LLMs on your laptop, entirely offline
👾 - Use models through the in-app Chat UI or an OpenAI compatible local server
📂 - Download any compatible model files from HuggingFace 🤗 repositories
🔭 - Discover new & noteworthy LLMs in the app's home pageHugging Face — The Home of Machine Learning
🍔 Lunch at SCaLE 🍇 — Let's put an official time down on the calendar to get together. The Yardhouse has always been a solid go-to, so sit down and break bread with the Unplugged crew during the lunch break on Saturday!
47 min