Onchain AI Garage

Content & Contributions

  • Explores advanced paradigms in Large Language Models (LLM) implementation and AI-driven knowledge management.
  • Karpathy’s LLM Wiki: Beyond RAG for Persistent Knowledge Bases
    • Investigates the LLM Wiki pattern as an evolution beyond traditional Retrieval Augmented Generation (RAG).
    • Focuses on the development of persistent, compounding knowledge bases maintained autonomously by LLM.
    • Backlink: 2026 04 10 Karpathys LLM Wiki Beyond RAG for Persistent Knowledge Bases

Additional Notes (2026-04-10)

  • The video introduces Andrej Karpathy’s innovative “LLM Wiki pattern,” a paradigm shift from traditional Retrieval Augmented Generation (RAG) models for managing personal knowledge bases.
  • Advocates for persistent, compounding wiki maintained entirely by LLM.
  • Addresses the fundamental problem of creating and maintaining autonomous knowledge repositories.

Authored Notes

  • 2026 04 10 Karpathys LLM Wiki Beyond RAG for Persistent Knowledge Bases
  • 2026 04 10 Karpathys LLM Wiki Beyond RAG for Persistent Knowledge Bases
  • 2026 04 10 Karpathys LLM Wiki Beyond RAG for Persistent Knowledge Bases

Source Notes

  • 2026-04-07: [[lab-notes/2026-04-07-Karpathys-LLM-Wiki-Beyond-RAG-for-Persistent-Knowledge-Bases|Karpathy’s LLM Wiki: Watch Me Build a Knowledge Base From]]
  • 2026-04-10: [[lab-notes/2026-04-10-Karpathys-LLM-Wiki-Beyond-RAG-for-Persistent-Knowledge-Bases|Karpathy’s LLM Wiki: Watch Me Build a Knowledge Base From]]