Text Generation Inference

A Rust, Python and gRPC server for text generation inference that is used in production at HuggingFace to power LLMs api-inference widgets

Rank

789 109

Git Repositories

text-generation-inference

Started

2022-10-08 921 days ago

GitHub Stars

9,756 #1,261

Weekly commits since inception

2022 2023 2025

Weekly contributors since inception

2022 2023 2025

Recent Project Activity

Past 30 days 31 commits #1,173 9 contributors #818
Past 90 days 153 commits #954 22 contributors #699
Past 365 days 726 commits #906 80 contributors #501
Past 1095 days 1,364 commits #1,381 145 contributors #738
All time 1,364 commits 145 contributors

Contributing Individuals

Commits past X days
30 90 365 1095 All
1 Nicolas Patry 14 60 219 362 362
2 OlivierDehaene 0 0 27 360 360
3 Daniël de Kok 1 22 158 158 158
4 drbh 0 8 104 134 134
5 Wang, Yi 3 11 48 49 49
6 Mohit Sharma 5 9 14 14 14
7 Hugo Larcher 0 6 10 10 10
8 Alvaro Bartolome 0 5 10 10 10
9 fxmarty 0 0 11 15 15
10 Baptiste Colle 3 5 7 7 7
11 Funtowicz Morgan 0 5 9 9 9
12 Erik Kaunismäki 1 1 8 8 8
13 David Corvoysier 0 4 4 4 4
14 Omar Sanseviero 0 0 2 11 11
14 Merve Noyan 0 0 0 13 13
14 Nick Hill
IBM
0 0 0 13 13
17 yuanwu2017 2 2 2 3 3
17 oOraph 1 1 2 6 6
19 Cyril Vallez 0 3 3 3 3
19 Lucain 0 0 5 5 5
Showing 1 to 20 of 145 results Previous Next
Contributing Companies

Add this OSSRank shield to this project's README.md

[![OSSRank](https://shields.io/endpoint?url=https://ossrank.com/shield/3146)](https://ossrank.com/p/3146)