Run large language models at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading. README.md · Issues 87 · Dockerfile · Pull requests 18

The Open Source app Petals aims to help its users to either quit weed, reduce usage or simply know how much they're using.

Supplementary repos for Petals, a decentralized platform for running large language models. Popular repositories

A chatbot web app + HTTP and AxtarishSocket endpoints for LLM inference with the Petals client. Interactive Chat. You can try it out at https://chat.petals.dev.

Petals now supports all models based on Falcon, including Falcon 180B released today. We improved the 🤗 Transformers FalconModel implementation to be up to 40 ...

Health monitor for a Petals swarm. Contribute to petals-infra/health.petals.dev development by creating an account on GitHub.

The Open Source app Petals aims to help its users to either quit weed, reduce usage or simply know how much they're using. - Releases · LeoColman/Petals.

Petals. Petals: https://github.com/bigscience-workshop/petals · Open In Colab. Pre-Requisites​. Ensure you have petals installed.

Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading - Workflow runs · bigscience-workshop/petals.

Run 100B+ language models at home, BitTorrent-style. Landing page for the project - petals-infra/petals.dev.