New open-source inference engine 'trnrt' for AWS Trainium released
Key point
RunanywhereAI has released 'trnrt', an open-source LLM inference engine for AWS Trainium, which supports a 1M-token context.
RunanywhereAI created a new open-source repository, 'RunanywhereAI/trnrt', on 2026-10-30. It has already reached 965 stars on GitHub.
The project uses Python as its main language and is released under the Apache-2.0 license. It is described as an open LLM inference engine for AWS Trainium, featuring NKI megakernels, a 1M-token context, and an OpenAI-compatible API.
This item is a summary. The full, checkable version is at the original source:
Read the original at GitHub New AI Repos ↗