Text Generation Inference

A Rust, Python and gRPC server for text generation inference that is used in production at HuggingFace to power LLMs api-inference widgets

Rank

661 106

Git Repositories

text-generation-inference

Started

2022-10-08 907 days ago

GitHub Stars

9,756 #1,261

Weekly commits since inception

2022 2023 2025

Weekly contributors since inception

2022 2023 2025

Recent Project Activity

Past 30 days 54 commits #891 18 contributors #446
Past 90 days 154 commits #951 26 contributors #601
Past 365 days 732 commits #904 83 contributors #483
Past 1095 days 1,346 commits #1,397 145 contributors #740
All time 1,346 commits 145 contributors

Contributing Individuals

Commits past X days
30 90 365 1095 All
1 Nicolas Patry 24 54 223 353 353
2 OlivierDehaene 0 0 33 360 360
3 Daniël de Kok 10 24 158 158 158
4 drbh 1 9 104 134 134
5 Wang, Yi 1 12 46 47 47
6 Mohit Sharma 2 7 10 10 10
7 Hugo Larcher 1 6 10 10 10
7 Alvaro Bartolome 1 6 10 10 10
9 fxmarty 0 0 11 15 15
10 Baptiste Colle 3 6 6 6 6
11 Funtowicz Morgan 0 5 9 9 9
12 Erik Kaunismäki 1 1 8 8 8
13 David Corvoysier 2 4 4 4 4
14 Omar Sanseviero 0 0 2 11 11
14 Nick Hill
IBM
0 0 0 13 13
14 Merve Noyan 0 0 0 13 13
17 Adrien Gallouët 1 3 3 3 3
18 Cyril Vallez 0 3 3 3 3
18 Lucain 0 0 5 5 5
20 celsowm 1 2 2 2 2
Showing 1 to 20 of 145 results Previous Next
Contributing Companies

Add this OSSRank shield to this project's README.md

[![OSSRank](https://shields.io/endpoint?url=https://ossrank.com/shield/3146)](https://ossrank.com/p/3146)