llama.cpp b10217 Debuts Tool Calling — Plus DeepSeek GGUF & NVIDIA SDKs

<p>Today's digest highlights significant updates, with llama.cpp's b10217 release introducing new tool calling capabilities. DeepSeek's V4-Flash model also landed as GGUF, alongside new NVIDIA SDKs for CUDA Python and video codecs, and an update to the Reckless Rust chess engine.</p> <h2> Local AI &amp; Open Models </h2> <p><em>This week sees key updates for local AI inference with llama.cpp b10217 enabling tool calls in chat and the Reckless chess engine reaching v0.9.0. Additionally, the DeepSeek-V4-Flash-0731 model is now available in GGUF format, making high-performance local inference more accessible on consumer GPUs.</em></p> <h3> llama.cpp b10217 Debuts Tool Calling in Chat (llama.cpp) </h3> <p>Source: <a href="https://github.com/ggml-org/llama.cpp/releases/tag/b10217" rel="noopener noreferrer">llama.cpp</a></p> <p>The latest update to llama.cpp, version b10217, introduces a notable enhancement for chat applications by enabling tool call functionality within the thinking phase for DS4 models. This feature allows models to leverage external tools or APIs during their generation process, moving beyond simple text generation to more complex, agent-like behaviors directly within the efficient llama.cpp runtime. The update is part of the ongoing evolution of llama.cpp, a foundational project for running large language models locally on consumer hardware, including macOS Apple Silicon and Linux systems.</p> <p>While the summary specifically mentions <code>chat : enable tool call in thinking for DS4 ( #26269 )</code>, implying a specialized capability, this addition is significant for developers looking to integrate LLMs with external services or build sophisticated local agents. The ability to invoke tools dynamically can greatly expand the utility of models running on resource-constrained devices, allowing them to perform tasks like fetching real-time data, performing calculations, or interacting with other software components. This release continues llama.cpp's commitment to advancing local AI inference, providing users with more powerful and versatile tools.</p> <blockquote> <p>Adding tool call capabilities directly within llama.cpp chat models is a game-changer for building sophisticated local agents. It drastically expands what can be done on a consumer GPU without relying on cloud APIs for tool orchestration.</p> </blockquote> <h3> Reckless Chess Engine v0.9.0 Ships, Advancing Rust-Based Competitive AI (Reckless (Rust chess)) </h3> <p>Source: <a href="https://github.com/codedeliveryservice/Reckless/releases/tag/v0.9.0" rel="noopener noreferrer">Reckless (Rust chess)</a></p> <p>The competitive chess engine, Reckless, has announced the release of version 0.9.0, marking a significant milestone for this Rust-based project. This update provides pre-built binaries for Windows, Linux, and macOS, making it readily accessible for enthusiasts and competitive players to download and utilize. As a first-class story in the realm of game AI, this release underscores the project's maturity and its growing presence in the competitive chess engine landscape, standing alongside established names like Stockfish and Leela Chess Zero.</p> <p>The development of Reckless, particularly its implementation in Rust, is of interest to developers for its focus on performance and memory safety, key attributes for high-performance computing tasks such as chess AI. While the specific changelog details for v0.9.0 aren't fully outlined in the summary, a major version increment typically implies substantial improvements in evaluation, search algorithms, or overall engine strength. For local AI and open models, Reckless exemplifies how advanced AI, utilizing complex neural network evaluation functions (NNUE) or sophisticated search algorithms, can be developed and deployed on consumer-grade hardware, providing a tangible example of cutting-edge AI runnable locally.</p> <blockquote> <p>A new stable release for a Rust-bas