OSS Project

Text Generation Inference

A Rust, Python and gRPC server for text generation inference that is used in production at HuggingFace to power LLMs api-inference widgets

Rank
666
Increased by 32
Git Repositories
text-generation-inference
Started
2022-10-08 835 days ago
GitHub Stars
9,603 #1,259
Weekly commits since inception
2022 2023 2025
Weekly contributors since inception
2022 2023 2025
Recent Project Activity
Day Span Commits Contributors
30 29 #986 12 #530
90 136 #946 25 #554
365 700 #952 87 #452
1095 1,221 #1,500 136 #791
All time 1,221 136
Contributing Individuals
Commits past X days
Contributor 30 90 All
1 Nicolas Patry 4 35 303
2 OlivierDehaene 0 9 360
3 Daniël de Kok 5 28 139
4 drbh 4 22 129
5 Wang, Yi 5 13 40
6 fxmarty 0 0 15
7 Mohit Sharma 3 4 6
8 Erik Kaunismäki 0 0 7
9 Nick Hill
IBM
0 0 13
9 Alvaro Bartolome 1 1 5
9 Merve Noyan 0 0 13
9 Omar Sanseviero 0 0 11
13 Funtowicz Morgan 0 3 4
14 Lucain 0 1 5
15 Hugo Larcher 0 2 4
16 Baptiste Colle 2 2 2
17 Guspan 1 2 3
18 Nicholas Broad 1 1 3
19 oOraph 0 0 5
19 Vaibhav Srivastav 0 0 4
Contributing Companies

Add this OSSRank shield to this project's README.md

[![OSSRank](https://shields.io/endpoint?url=https://ossrank.com/shield/3146)](https://ossrank.com/p/3146)