alex-ziskind

---

Alex Ziskind

Alex Ziskind is a prominent figure in the field of artificial intelligence and machine learning. He regularly publishes content on innovative tools and methodologies for running large language models (LLMs) and AI video generation across various devices, emphasizing local and private inference.

Notable Works

• Tiiny AI Pocket Lab: Local LLM Execution on Compact Hardware

  • Clip title: This Shouldn’t Be Able to Run 120B Locally
  • Author / channel: Alex Ziskind
  • URL: https://www.youtube.com/watch?v=RkzCAaIV_cQ
  • Summary:
    • Introduces the Tiiny AI Pocket Lab, a compact device capable of running large language models (e.g., 120B parameters) locally.
    • Challenges the dependency on extensive, expensive GPU hardware.
    • Demonstrates efficient on-device AI processing for privacy and accessibility.
  • Related Note: Tiiny AI Pocket Lab: Running Large Language Models Locally and Privately

• LM Studio LM Link: Remote LLM Access for Portable Devices

  • Clip title: Private AI on the running… a new trick
  • Author / channel: Alex Ziskind
  • URL: https://www.youtube.com/watch?v=PqBrnip-ZLw
  • Summary:
    • Demonstrates running large language models on portable devices.
    • Contrasts high-end MacBooks with more portable alternatives.
    • Highlights the role of innovative tools in closing capability gaps.

• **TurboQuant Reducing LLM Memory Footprint via [[concepts/inference