local inference

oprel

High-performance Python library by Oprel for running large language models locally, featuring production-ready runtime, advanced memory management, hybrid offloading, and full multimodal support.