GPT-4

Advanced large language model developed by OpenAI, succeeding GPT-3.5. Excels in complex reasoning, code generation, and multi-modal tasks.

• Hallucinations: GPT-4 can generate ai-hallucinations (plausible but factually incorrect outputs), a widespread issue not limited to minor bugs. The YouTube Summary Report (20cal 03-06, Gemini 2.5 Flash) details this pervasive problem in LLMs.
• Training Cost & Quantisation: GPT-4’s 2023 training cost was estimated at $78 million (Sam Altman claimed higher), highlighting LLM training’s economic challenges. 4-bit quantisation reduces computational costs by enabling 4-bit precision training, as explored in Julia Turc’s 2026 video.

2026 04 14 AI Hallicinations

Source Notes

• 2026-04-14: [[lab-notes/2026-04-14-Optimizing-AI-Costs-and-Privacy-with-Local-Open-Source-Models-and-Hybr|“But OpenClaw is expensive…“]]
• 2026-04-14: # Julian Goldie SEO channel GLM 4.7 --- --- https://www.youtube.com/watch?v=uy7F7u8A0jo # GLM-4.7: Advancing the Coding Capability & Business Automation GLM-4.7 is the latest [[concepts/open-source|open-sour (Julian Goldie SEO channel GLM 4.7)
• 2026-04-14: How to get TACK SHARP photos with any camera!
• 2026-04-14: [[lab-notes/2026-04-14-Optimizing-AI-Costs-and-Privacy-with-Local-Open-Source-Models-and-Hybr|“But OpenClaw is expensive…“]]