Get Started
A Flutter Plugin for Android and IOS based on MNN-LLM.
| Android | iOS | |
|---|---|---|
| Support | SDK 26+ | Not Supported |
Getting Started
Add mnnllm as a dependency in your pubspec.yaml file.
dependencies:
mnnllm: ^{{latest version}}
Replace latest version with the version number in badge above.
Runtime Screenshot
Usage
- Import Package.
import 'package:mnnllm/mnnllm.dart';
- Download Model.
await _mnnllmPlugin.downloadWithListen(modelID, listen: (state) {
setState(() {
downloadingState = state;
});
});
- Initialize Model.
int? val = await _mnnllmPlugin.initModel(
modelID,
_mnnllmPlugin.getModelName(modelID),
configPath,
_mnnllmPlugin.getSessionId(null),
keepHistory: false
);
- Generate Tokens.
_mnnllmPlugin.generateStreamAnswer(inputText,
(data) { setState(() { generateText = data.toString(); }); },
(err) { print(err.toString()); });
Warnings
- The development for the iOS platform is still proceeding in pace.
RoadMap
- Support for iOS platform
- Support for text-to-image generation models
- Support for multimodal large models
Contact Me
Liu liuzhi1999@foxmail.com