OSS Project

Text Generation Inference

A Rust, Python and gRPC server for text generation inference that is used in production at HuggingFace to power LLMs api-inference widgets

Rank
653
Increased by 112
Git Repositories
text-generation-inference
Started
2022-10-08 847 days ago
GitHub Stars
9,656 #1,258
Weekly commits since inception
2022 2023 2025
Weekly contributors since inception
2022 2023 2025
Recent Project Activity
Day Span Commits Contributors
30 60 #777 16 #495
90 140 #948 27 #541
365 698 #942 83 #488
1095 1,252 #1,474 138 #779
All time 1,252 138
Contributing Individuals
Commits past X days
Contributor 30 90 All
1 Nicolas Patry 17 37 316
2 OlivierDehaene 0 4 360
3 Daniël de Kok 8 26 142
4 drbh 4 19 129
5 Wang, Yi 6 13 41
6 Mohit Sharma 5 6 8
7 Funtowicz Morgan 4 5 8
8 fxmarty 0 0 15
9 Hugo Larcher 3 5 7
10 Alvaro Bartolome 3 3 7
11 Erik Kaunismäki 0 0 7
12 Omar Sanseviero 0 0 11
12 Nick Hill
IBM
0 0 13
12 Merve Noyan 0 0 13
15 Lucain 0 1 5
16 Baptiste Colle 2 2 2
16 Cyril Vallez 2 2 2
18 Guspan 1 2 3
19 Nicholas Broad 1 1 3
20 Vaibhav Srivastav 0 0 4
Contributing Companies

Add this OSSRank shield to this project's README.md

[![OSSRank](https://shields.io/endpoint?url=https://ossrank.com/shield/3146)](https://ossrank.com/p/3146)