Android Edge AI Runtime for Unity enables Unity Android projects to run compatible GGUF-format local language models directly on the Android device.
Unity C# communicates with a native llama.cpp-based runtime through the included native shim. Local inference runs inside the Android application without requiring an HTTP server, WebSocket server, Python environment, or cloud service.
The package includes:
• A minimal Android chat sample scene
• Unity C# runtime components
• Android arm64-v8a native libraries
• UTF-8-safe multilingual text handling
• Automatic chat-template application for compatible models
• Single-flight generation control to prevent overlapping inference requests
• Runtime and model configuration options
• Setup and model-placement documentation
• Third-party license notices
GGUF model files are not included. Developers select and place their own compatible GGUF model on the Android device.
This package is intended for developers building:
• Offline-capable AI applications
• Interactive characters and virtual agents
• Local AI prototypes
• Robotics interfaces
• Edge AI demonstrations and experiments
• Unity applications that require on-device language-model inference
Requirements and limitations:
• Android only
• arm64-v8a only
• IL2CPP scripting backend required
• CPU inference backend
• Inference must be tested on an Android device
• Unity Editor inference is not supported
• Performance and memory usage depend on the Android device, model architecture, model size, quantization, context size, and runtime settings
• Compatibility with every GGUF model is not guaranteed
Third-party software:
This package uses llama.cpp and ggml under the MIT License, and LLVM libc++ under the Apache License 2.0 with LLVM Exceptions.
See the included THIRD_PARTY_NOTICES.md and license files for complete details.