OSS Project

Text Generation Inference

A Rust, Python and gRPC server for text generation inference that is used in production at HuggingFace to power LLMs api-inference widgets

Rank
709
Increased by 36
Git Repositories
text-generation-inference
Started
2022-10-08 733 days ago
GitHub Stars
8,847 #1,306
Weekly commits since inception
2022 2023 2024
Weekly contributors since inception
2022 2023 2024
Recent Project Activity
Day Span Commits Contributors
30 59 #810 13 #606
90 207 #751 25 #616
365 603 #1,073 85 #493
1095 1,059 #1,652 123 #887
All time 1,059 123
Contributing Individuals
Commits past X days
Contributor 30 90 All
1 Nicolas Patry 16 43 262
2 OlivierDehaene 3 10 350
3 Daniël de Kok 20 67 103
4 drbh 6 41 105
5 Wang, Yi 3 11 25
6 fxmarty 0 0 15
7 Erik Kaunismäki 0 7 7
8 Alvaro Bartolome 3 3 3
9 Adrien 0 4 4
10 Nick Hill
IBM
0 0 13
10 Merve Noyan 0 0 13
12 Omar Sanseviero 0 0 9
12 Orhun Parmaksız 2 2 2
12 Vaibhav Srivastav 0 3 3
15 Lucain 0 0 4
16 flozi00 1 1 3
16 Nicholas Broad 1 1 2
18 Hugo Larcher 0 2 2
19 oOraph 0 0 4
19 Mishig Davaadorj 0 0 5
Contributing Companies

Add this OSSRank shield to this project's README.md

[![OSSRank](https://shields.io/endpoint?url=https://ossrank.com/shield/3146)](https://ossrank.com/p/3146)