Cactus Needle

Cactus Needle is an open-source large-language-model developed by Cactus Compute, optimized for efficient function-calling on edge devices.

Key Characteristics

• Parameter Count: 26M parameters, making it exceptionally compact for its capabilities.
• Primary Use Case: Specialized in high-efficiency function calling tasks.
• Deployment Target: Designed for edge-computing environments where resource constraints are critical.
• License: Open-source.

Sources & References

• Cactus Needle: A Compact 26M Model for Efficient Edge Function Calling
• Cactus Needle: A Compact 26M Model for Efficient Edge Function Calling (Video by Sam Witteveen)