New open-source inference engine 'trnrt' for AWS Trainium released

Local & Open Source✍ TextPublished: Source: GitHub New AI Repos

#Amazon #OpenAI

Key point

RunanywhereAI has released 'trnrt', an open-source LLM inference engine for AWS Trainium, which supports a 1M-token context.

RunanywhereAI created a new open-source repository, 'RunanywhereAI/trnrt', on 2026-10-30. It has already reached 965 stars on GitHub.

The project uses Python as its main language and is released under the Apache-2.0 license. It is described as an open LLM inference engine for AWS Trainium, featuring NKI megakernels, a 1M-token context, and an OpenAI-compatible API.

This item is a summary. The full, checkable version is at the original source:

Read the original at GitHub New AI Repos ↗