Text Generation Inference

A Rust, Python and gRPC server for text generation inference that is used in production at HuggingFace to power LLMs api-inference widgets

Rank

659 74

Git Repositories

text-generation-inference

Started

2022-10-08 900 days ago

GitHub Stars

9,756 #1,261

Weekly commits since inception

2022 2023 2025

Weekly contributors since inception

2022 2023 2025

Recent Project Activity

Past 30 days 57 commits #829 17 contributors #469
Past 90 days 153 commits #917 25 contributors #609
Past 365 days 735 commits #893 82 contributors #491
Past 1095 days 1,345 commits #1,404 144 contributors #747
All time 1,345 commits 144 contributors

Contributing Individuals

Commits past X days
30 90 365 1095 All
1 Nicolas Patry 24 54 223 353 353
2 OlivierDehaene 0 0 35 360 360
3 Daniël de Kok 10 24 158 158 158
4 drbh 2 9 106 134 134
5 Wang, Yi 2 12 46 47 47
6 Mohit Sharma 2 7 10 10 10
7 Hugo Larcher 1 6 10 10 10
7 Alvaro Bartolome 1 6 10 10 10
9 Baptiste Colle 4 6 6 6 6
10 fxmarty 0 0 11 15 15
11 Funtowicz Morgan 0 5 9 9 9
12 Erik Kaunismäki 1 1 8 8 8
13 David Corvoysier 3 4 4 4 4
14 Omar Sanseviero 0 0 2 11 11
14 Nick Hill
IBM
0 0 0 13 13
14 Merve Noyan 0 0 0 13 13
17 Adrien Gallouët 1 3 3 3 3
18 Cyril Vallez 0 3 3 3 3
18 Lucain 0 0 5 5 5
20 celsowm 1 2 2 2 2
Showing 1 to 20 of 144 results Previous Next
Contributing Companies

Add this OSSRank shield to this project's README.md

[![OSSRank](https://shields.io/endpoint?url=https://ossrank.com/shield/3146)](https://ossrank.com/p/3146)