guinmoon/LLMFarm 排名第 9,013，此处有 8 个同类条目；vitoplantamura/OnnxStream 排名第 9,008。

LLMFarm The app is temporarily unavailable in TestFlight and Appstore. It allows you to load different LLMs with certain parameters. With LLMFarm, you can test the performance of different LLMs on iOS and macOS and find the most suitable model for your project. Features [x] MacOS (13+) [x] iOS (16+) [x] Various inferences [x] Various sampling methods [x] Metal (dont work on intel Mac) [x] Model setting templates [x] Restore context state [x] Apple Shortcuts [x] RAG Inferences [x] LLaMA

[x] Gemma [x] Phi [x] GPT2 + Cerebras [x] Starcoder(Santacoder) [x] Falcon [x] MPT [x] Bloom [x] StableLM-3b-4e1t [x] Qwen [x] Yi models [x] Deepseek models [x] Mixtral MoE [x] PLaMo-13B [x] Mamba [x] RWKV [x] GPTNeoX See full list here. 6 models [x] BakLLaVA [x] Obsidian [x] ShareGPT4V [x] MobileVLM 1. 7B/3B models [x] Yi-VL [x] Moondream Note: For *Falcon, Alpaca, GPT4All, Chinese LLaMA / Alpaca and Chinese LLaMA-2 / Alpaca-2, Vigogne (French), Vicuna

, Koala, OpenBuddy (Multilingual), Pygmalion/Metharme, WizardLM, Baichuan 1 & 2 + derivations, Aquila 1 & 2, Mistral AI v0. 1, Refact, Persimmon 8B, MPT, Bloom* select in model settings. Sampling methods [x] Temperature (temp, tok-k, top-p) [x] Tail Free Sampling (TFS) [x] Locally Typical Sampling [x] Mirostat [x] Greedy [x] Grammar Getting Started You can find answers to some questions in the FAQ section. Inference options When creating a chat, a JSON file is generated in which you can specify additional

inference options. The chat files are located in the "chats" directory. Models You can find some of the supported models here. Development has been moved to a separate repository. To build llmfarm, you need to clone this repository recursively: Also used sources from: rwkv. cpp by saharNooby Mia by byroneverson LlamaChat by alexrozanski swift-markdown-ui by gonzalezreal similarity-search-kit by ZachNagengast ❤️ Support project