Grok Bot Orchestration, GLM 5.3, CMP 170HX Unlocked — AI Daily Aug 22

304 messages · 58 active members

304
messages
58
active members
@jasonakatiff, @jcartu, @Tz1888
top contributors

Overview

Saturday's chat was dominated by hands-on model orchestration experiments. anonymous led an in-depth Grok bot migration off Hermes — using Fable to write a handoff spec, then having Grok bot itself audit the setup, seed 8 sub-bots, and learn tasks natively from screen recordings. Consensus: Grok bot's polish and speed feel close to local models and 'light years faster than CC/Codex,' though jailbreaking and multi-model support are still WIP. Meanwhile @jcartu made the case for rotating GLM, Kimi K3, and Codex per task, orchestrating with Gemini rather than Fable. Hardware talk went deep on the CMP 170HX — now unlocked and measured at 164 TFLOPS FP16 with 64GB verified, at ~$1.2–1.5k per card. ServeTheHome forums documented how to distinguish it from an A100, and a GitHub issue confirmed three cards running DeepSeek under VLLM 0.26. @jcartu reiterated GLM 5.3 is same-size weights as 5.2 with ~20% smarter tuning, dropping in a week — no need to chase Kimi K3's 2.8T params. @Tz1888 is weighing 4x DGX Spark vs a single RTX Pro 6000. On workflow and research, @tounano shared a mature deviation-log code review pipeline compressing multi-hour agent runs into 20-min human reviews. @leewardbound is building an 'illustrator' skill that renders HTML one-pagers for mobile absorption of agent output. Shared links surfaced Vercel's Is Agentic readiness score, Dreadnode's prompt-level cheating mitigation research, Alibaba's Qwen-UI-Agent technical report, and Nile positioning as a backend for agentic commerce.

Topics

anonymous documented a full Grok bot setup: Fable wrote a handoff spec, Grok bot ran an unbiased self-audit, then a chief-of-staff bot merged both plans to build 8 sub-bots. After ~15% of weekly usage he says Grok bot feels smoother than Hermes, close to local model speeds, and delegates cleanly to CC/Codex/local models. Open questions remain on jailbreaking, browser task token burn, and Grok-only model lock-in.

The CMP 170HX has been unlocked and measured at 164 TFLOPS FP16 with 64GB verified for ~$1.2–1.5k, with VLLM 0.26 already running DeepSeek across three cards. Trade-offs remain: PCIe Gen 2, no NVLink, quirky drivers. @jcartu emphasized GLM 5.3 is a tuned 5.2 (~20% smarter, same weights) dropping in a week and fits on four cards — no need to chase Kimi K3's 2.8T params.

@tounano shared his refined Fable pipeline: Opus implementer agents write pragmatic-decision deviation logs, a Fable High orchestrator spawns new agents to resolve them, and a second Fable pass surfaces only what needs human judgment. Result: 20-minute human review of multi-hour runs. Bonus insight — agents reliably self-report when they wrote shitty code.

Vercel's Is Agentic launched an AI Agent Readiness Score for benchmarking stack preparedness for agent workloads. Dreadnode shared research on prompt-level mitigation of model cheating on offensive cyber tasks. Alibaba's Tongyi team published a Qwen-UI-Agent technical report on UI-grounded agent capabilities, and Nile positioned itself as a backend purpose-built for agentic commerce.

@leewardbound is building an Orca skill that renders HTML one-pagers explaining feature branches, bugfixes, or perf test results — replacing terminal walls-of-text. Thesis: at a PC you can absorb dense output, but mobile/away requires visual synthesis. @iannagy independently converged on the same pattern using R2-hosted HTML pages for storyboarding and iteration.

Key Takeaways

  • Grok bot's polish and native task-learning from screen recordings make it a serious Hermes challenger, but Grok-only model lock-in is a real constraint for power users.
  • GLM 5.3 (dropping in ~1 week) is same-size weights as 5.2 with ~20% smarter tuning — fits on 4 cards, no need to chase multi-trillion-param models like Kimi K3.
  • CMP 170HX is unlocked at 164 TFLOPS FP16 / 64GB verified for ~$1.2–1.5k, with VLLM 0.26 already running DeepSeek across 3 cards — a cheap large-VRAM path for inference.
  • Deviation-log pattern (agents write pragmatic-decision logs, orchestrator resolves, human reviews remainder) compresses multi-hour agent runs into 20-min reviews.
  • For mobile/away workflows, render agent output as HTML one-pagers instead of terminal wall-of-text — dramatically better absorption of complex state.

Hot Threads

anonymousstarted

Migrating from Hermes to Grok bot as primary orchestrator

14 replies6 participants
anonymousstarted

CMP 170HX 64GB rigs unlocked for running GLM 5.3 locally

22 replies4 participants
@RayTGcontactstarted

Making AI media-buying agents follow kill rules reliably

10 replies4 participants

Linked Items