Local AI Rigs, Palmier Pro, Hermes Memory — AI Daily Oct 24

519 messages · 63 active members

519
messages
63
active members
@anonymous, @greglavidaloca, @jcartu
top contributors

Overview

October 24 was dominated by a long debate on local AI hardware economics after Anthropic's earnings report. @jcartu laid out the math: no sub-€100k rig touches frontier like DeepSeek V4.1 Flash or Opus 5.5, and even his 4-GPU setup runs non-frontier at 500 TPS vs cloud frontier anywhere. Consensus: with GPU, RAM, and disk prices through the roof — @geilt noted DDR5 kits bought for $200-400 are now $1,100-1,800 — local only makes sense as a hobby or if you have 8+ devs hammering 24/7, otherwise multi-account API routing (Google/Claude/Codex) wins. AI video editing had a breakout moment. @ariangrtyi shipped a fully AI-generated ad using Palmier Pro, an open-source macOS editor, while @zippi101 demoed 'Videos that Sell,' a Seedance-powered one-shot 30-second ad generator. The group compared Wan 3 (480p sweet spot), Kling 4, Higgsfield, and the upcoming Muse, with ElevenLabs voice-to-voice as the recommended lip-sync polish. @WhiskeyATX shared his Davinci + Codex + Grok stack for YouTube policy workarounds. On tooling, @jcartu detailed a hook-based pattern for upgrading Hermes to Hindsight 1.0 that lets the agent self-teach new features, sparking a Hindsight vs mem0 benchmark commitment from @GuruTime. Hermex shipped a bot mode that may replace Grokbot for team Telegram workflows. New model releases (Kimi 3.1 Pro, Minimax 3.1 Flash, Deepseek) have builders anticipating GLM 5.4, and Opus 5.5 is reportedly faster this week.

Topics

@jcartu made the case that no sub-€100k local setup touches frontier models like DeepSeek V4.1 Flash or Opus 5.5, and even at 30-50 TPS on a $10k rig you're 'walking vs driving a Lamborghini' compared to 500+ TPS cloud. Compounding the problem, @geilt flagged DDR5 RAM prices 4-5x'd since July. Consensus: multi-account API routing wins unless you're a hobbyist or running 8+ devs 24/7.

@ariangrtyi showcased Palmier Pro (open-source macOS AI video editor) after a fully AI-generated ad outperformed manual edits. @zippi101 demoed 'Videos that Sell,' a Seedance-powered one-shot 30-second ad generator. The group compared Wan 3 (480p price/quality winner), Kling 4, and Higgsfield, with ElevenLabs voice-to-voice recommended for lip-sync polish and @WhiskeyATX endorsing Grok for YouTube policy neuters.

@jcartu detailed a hook-based pattern that reinstalls personal Hermes customizations on every update and lets the agent self-teach new Hindsight features, arguing Hindsight is SOTA over mem0 — @GuruTime committed to a sandboxed head-to-head. Separately, Hermex shipped a bot mode that could replace Grokbot for team Telegram workflows, with @samb69 noting Hermes already has an official bot mode worth comparing.

@anonymous tested Kimi 3.1 Pro and suspects heavy distillation from GPT Astra 6, calling it 'too compliant.' With Kimi, Minimax 3.1 Flash, and Deepseek all shipping recently, the group expects GLM 5.4 imminently. Opus 5.5 is reportedly faster this week, while Codex resets are hitting so often users can'anonymous even bank them — prompting jokes about a token exchange marketplace.

@robinroy kicked off a thread about running agents from phone, with suggestions including Hoplite.sh, Hermes-via-Telegram patterns, and OpenClaw. @watchmedropship noted you can port Hermes to iOS via an Apple developer account. Separately, @miyamotaz surfaced wiltodelta/remove-ai-watermarks, which strips visible marks and invisible provenance metadata (SynthID, C2PA, EXIF, IPTC, XMP) from AI-generated media.

Words worth knowing

Three terms from the glossary.

Key Takeaways

  • Local AI rigs still don'anonymous pencil out vs cloud APIs unless you're a hobbyist or running 8+ devs 24/7 — DDR5 RAM prices have 4-5x'd since July, making the gap worse.
  • Wan 3 at 480p with reference images is the current price/quality sweet spot for AI video ads; route output through ElevenLabs voice-to-voice for lip-sync polish.
  • Hindsight 1.0 can be auto-upgraded via a hook that lets your Hermes agent re-apply customizations and self-learn new features on each update.
  • DeepSeek V4.1 Flash is the best model realistically runnable on 4 GPUs today, enabled by RAM/SSD engram offloading.
  • Expect GLM 5.4 soon after the Kimi 3.1 Pro / Minimax 3.1 Flash / Deepseek release cluster; Opus 5.5 is running faster this week.

Hot Threads

@nowwatchthisdrivestarted

Local setup vs cloud after Anthropic earnings scare

45 replies8 participants
@zippi101started

Videos that Sell: one-prompt Seedance ad generator

25 replies6 participants
@rmktgstarted

Hermes + Hindsight upgrade workflow and mem0 comparison

15 replies5 participants

Linked Items