Local LLMs, Deterministic Agents, Comment Seeding — AI Daily Oct 16

653 messages · 73 active members

653
messages
73
active members
@anonymous, @jcartu, @geilt
top contributors

Overview

October 16 ran heavy on technical craft, with builders digging into local model viability, deterministic agent architecture, and the growing toolkit for ad ops automation. @weslindquist shared a real production setup running Qwen 3 27B on a 128GB Mac Studio to anonymize bookkeeping data before passing it to Opus, while @jcartu argued most single-user local setups still lack a business case — though GLM and DeepSeek 4.1F are closing the gap fast. @geilt dropped an extended philosophy on agent design: push logic into deterministic tools, validate inputs (like confirming email addresses before sending), and treat LLMs as stochastic components wrapped in software that enforces QA. The same thread extended to tool design — descriptive errors, CLI-style help, and freely letting agents edit files while constraining external APIs. On the ad ops side, @kmal1818 introduced an AI ad agency 'superteam' MVP using Grok Bots as orchestrators over specialist agents (Research → Copy → Image → Video → Media Buying), scraping AdPlexity via Stagehand + Browserbase. A parallel thread compared Comdrop, Myko's rebranded Exerta, and Hermes for comment seeding, with consensus that reply bots and negative comment scrubbing add 2-5% to revenue. An anonymous builder shared a $4-CPL B2B funnel using competitor-brand hooks on Meta plus personalized interstitial pages. Model chatter stayed active: Claude Opus has degraded noticeably post-patch, Opus 5.5 dominates daily workflows for most builders, Grok's new Unify Ultra plan silently downgrades existing SuperGrok Heavy perks, and recommendations for less-restricted work pointed to Venice, DeepSeek 4, and abliterated models. Lighter threads covered Tesla's thruster car demo, ElevenLabs alternatives (Fish Audio, Descript) for multi-character dialogue, and replacing cramped multi-terminal agent UIs with Telegram threads for 50+ parallel tasks.

Topics

Builders compared Qwen 3 27B, GLM, and DeepSeek 4.1F running locally against Claude Opus and Sonnet. @weslindquist uses Qwen 3 27B on a 128GB Mac Studio to anonymize bookkeeping data before Opus handoff. Consensus: local is ~6-12 months behind frontier, best for privacy, uncensored work, and high-volume extraction — pair with verification rather than trusting internal state.

@geilt gave an extended breakdown on stochasticism vs determinism: push hard-coded values into JSON contracts, build tool calls that validate inputs, and let agents handle only non-repeatable reasoning. Related rule: let agents freely edit files but wrap external APIs behind well-designed tools with descriptive errors and CLI-style help. If a human can figure it out, an agent can too.

@kobegatsby triggered a comparison of Comdrop, Myko's rebranded Exerta (formerly ReEngage), and Hermes moderation. Consensus: reply bots add 2-5% revenue and improve page health by hiding negative comments. @rmktg flagged a BM issue where Product B ads got Product A bot replies, prompting requests for better filtering and offer rules.

@kmal1818 introduced an MVP tiered agent system using Grok Bots as orchestrators over specialist tools. Build order: Research Bot → Copy/Image → Video → Media Buying for Meta/NewsBreak/SmartNews/MediaGo. Stack uses Cursor, Stagehand + Browserbase to scrape AdPlexity 3-4 hours daily, with cheap AI triage feeding a Grok Research Bot for swipe-worthy breakdowns.

Multiple members reported Claude Opus getting worse post-patch, with Opus dropping to 4.8 after a security update. Opus 5.5 still dominates daily workflows (~90% for one builder, with Sol for reviews). xAI's new Unify Ultra plan silently downgrades existing SuperGrok Heavy perks and Cursor model access. For guardrail workarounds: Venice, DeepSeek 4 via OpenRouter, nanoGPT with GLM 5.3 uncensored, and abliteration.ai.

Words worth knowing

Three terms from the glossary.

Key Takeaways

  • Local models (GLM, Qwen 3 27B, DeepSeek 4.1F) are viable for privacy-sensitive workflows but still trail frontier — best paired with Claude/GPT for planning, not as full replacements.
  • Wrap stochastic LLM calls in deterministic tool contracts: validate inputs, pull config from JSON, design tools like CLIs with descriptive errors and usage examples.
  • Reply bots and negative comment scrubbing (Exerta, Comdrop) consistently add 2-5% revenue and improve page health — worth it for scrubbing alone.
  • Grok's new Unify Ultra plan silently downgrades existing SuperGrok Heavy perks and Cursor model access — read before upgrading.
  • Replace cramped multi-terminal agent UIs with chat-based orchestration (Telegram threads, one bot per client) to run 10x more parallel tasks with notification-driven attention.

Hot Threads

@weslindquiststarted

Local model setup for bookkeeping data anonymization and frontier comparison

30 replies4 participants
@jcartustarted

Tesla thruster car demo and SpaceX's aerodynamics advantage

30 replies8 participants
@geiltstarted

Deterministic tool design and stochastic vs deterministic agents

25 replies4 participants

Linked Items