Text Generation Inference

A Rust, Python and gRPC server for text generation inference that is used in production at HuggingFace to power LLMs api-inference widgets

Rank

752 61

Git Repositories

text-generation-inference

Started

2022-10-08 915 days ago

GitHub Stars

9,756 #1,261

Weekly commits since inception

2022 2023 2025

Weekly contributors since inception

2022 2023 2025

Recent Project Activity

Past 30 days 35 commits #1,115 10 contributors #758
Past 90 days 157 commits #946 24 contributors #645
Past 365 days 731 commits #899 83 contributors #481
Past 1095 days 1,356 commits #1,387 145 contributors #739
All time 1,356 commits 145 contributors

Contributing Individuals

Commits past X days
30 90 365 1095 All
1 Nicolas Patry 15 58 220 357 357
2 OlivierDehaene 0 0 30 360 360
3 Daniël de Kok 4 22 158 158 158
4 drbh 0 8 104 134 134
5 Wang, Yi 1 11 46 47 47
6 Mohit Sharma 5 10 13 13 13
7 Baptiste Colle 4 7 7 7 7
8 Hugo Larcher 0 6 10 10 10
8 Alvaro Bartolome 0 6 10 10 10
10 fxmarty 0 0 11 15 15
11 Funtowicz Morgan 0 5 9 9 9
12 Erik Kaunismäki 1 1 8 8 8
13 David Corvoysier 1 4 4 4 4
14 Omar Sanseviero 0 0 2 11 11
14 Nick Hill
IBM
0 0 0 13 13
14 Merve Noyan 0 0 0 13 13
17 oOraph 1 1 3 6 6
18 yuanwu2017 2 2 2 3 3
19 Cyril Vallez 0 3 3 3 3
19 Lucain 0 0 5 5 5
Showing 1 to 20 of 145 results Previous Next
Contributing Companies

Add this OSSRank shield to this project's README.md

[![OSSRank](https://shields.io/endpoint?url=https://ossrank.com/shield/3146)](https://ossrank.com/p/3146)