Text Generation Inference

A Rust, Python and gRPC server for text generation inference that is used in production at HuggingFace to power LLMs api-inference widgets

Large Language Model (LLM)
started in 2022
1,410 commits
148 contributors

Rank

1061 241

Git Repositories

Started

2022-10-08 984 days ago

GitHub Stars

9,756 #1,261

Weekly commits since inception
2022 2023 2025

Weekly contributors since inception
2022 2023 2025

Recent Project Activity

Time Period Commits Contributors
Past 30 days 22 commits #1,273 4 contributors #1,334
Past 90 days 67 commits #1,371 15 contributors #928
Past 365 days 633 commits #970 66 contributors #601
Past 1095 days 1,410 commits #1,348 148 contributors #725
All time 1,410 commits 148 contributors

Contributing Individuals

Contributor 30 days 90 days 365 days 1095 days All time
1 Nicolas Patry
0 13 171 365 365
2 OlivierDehaene
0 0 20 360 360
3 Daniël de Kok Explosion
4 7 145 165 165
4 drbh
0 3 86 137 137
5 Wang, Yi
9 15 56 62 62
6 yuanwu2017
8 11 11 12 12
7 Mohit Sharma
0 6 16 16 16
8 Alvaro Bartolome
0 2 12 12 12
9 Hugo Larcher
0 0 10 10 10
10 Funtowicz Morgan
0 0 9 9 9
11 fxmarty
0 0 1 15 15
11 Erik Kaunismäki
0 0 8 8 8
13 Baptiste Colle
0 1 7 7 7
14 Omar Sanseviero
0 0 2 11 11
14 Merve Noyan
0 0 0 13 13
14 Nick Hill IBM
0 0 0 13 13
14 David Corvoysier
1 1 5 5 5
18 oOraph
0 1 2 6 6
19 Adrien
0 0 4 4 4
19 Vaibhav Srivastav
0 0 4 4 4
Showing 1 to 20 of 148 results
Previous Next

Contributing Companies

Add the OSSRank badge to this project

OSSRank Badge Add this OSSRank shield to your project's README.md
[![OSSRank](https://shields.io/endpoint?url=https://ossrank.com/shield/3146)](https://ossrank.com/p/3146)