airllm lyogavin

AirLLM 70B inference with single 4GB GPU

Hauptsprache
Jupyter Notebook
Stars
30,779
Forks
3,273

README

![airllm_logo](https://github.com/lyogavin/airllm/blob/main/assets/airllm_logo_sm.png?v=3&raw=true) [**Quickstart**](#quickstart) | [**Configurations**](#configurations) | [**MacOS**](#macos) | [**Example notebooks**](#example-python-notebook) | [**FAQ**](#faq) **AirLLM** dramatically reduces infer…

查看完整页面