Free tool "smolmaxxing" allows running 16 billion parameter AI locally even on old iPads or small terminals with 1GB memory

Local & Open SourcePublished: Source: Gigazine
Key point

The open source project "smolmaxxing" has been released, making it possible to run AI models even on old tablets or small devices. It allows AI models to be executed even on terminals with limited memory capacity, and operation has been confirmed on the first generation iPad Air released in 2013 and small terminals for televisions.

The open source project "smolmaxxing" has been released. This tool makes it possible to run AI models even on old tablets or small devices.

It allows for operation on terminals with limited memory capacity, and operation has been confirmed on the first generation iPad Air released in 2013 and small terminals for televisions. This enables running 16 billion parameter AI models locally.

This item is a summary. The full, checkable version is at the original source:

Read the original at Gigazine ↗