OSS Project

Text Generation Inference

A Rust, Python and gRPC server for text generation inference that is used in production at HuggingFace to power LLMs api-inference widgets

Rank
695
Increased by 5
Git Repositories
text-generation-inference
Started
2022-10-08 776 days ago
GitHub Stars
9,106 #1,285
Weekly commits since inception
2022 2023 2024
Weekly contributors since inception
2022 2023 2024
Recent Project Activity
Day Span Commits Contributors
30 60 #768 12 #628
90 174 #866 26 #592
365 669 #989 81 #503
1095 1,149 #1,562 128 #846
All time 1,149 128
Contributing Individuals
Commits past X days
Contributor 30 90 All
91 xiaobin 0 0 1
91 Leo Tronchon 0 0 1
91 Peter Lowrance 0 0 1
91 Martin Vejvar 0 0 1
91 momonga 0 0 1
91 Mario928 0 0 1
91 Remy 0 0 1
91 star 0 0 1
Contributing Companies

Add this OSSRank shield to this project's README.md

[![OSSRank](https://shields.io/endpoint?url=https://ossrank.com/shield/3146)](https://ossrank.com/p/3146)