Petals Features
Open source tool for running large language models like BLOOM-176B collaboratively — you load a small part of the model, then team up with people serving the other parts to run inference or fine-tuning.
• Easy to use: no need to install any software, just run the command line tool.
• Supports multiple languages: English, French, German, Spanish, Italian, Chinese, Japanese, Korean, and more.
• Supports multiple models: BERT, GPT-2, XLNet, RoBERTa, ALBERT, and more.
• Supports multiple tasks: text classification, question answering, sentiment analysis, and more.
• Supports multiple cloud providers: Google Cloud Platform, Amazon Web Services, Microsoft Azure, and more.
• Supports multiple hardware configurations: GPUs, TPUs, CPUs, and more.
• Supports multiple frameworks: TensorFlow, PyTorch, MXNet, and more.
• Supports multiple operating systems: Linux, macOS, Windows, and more.