Text Generation Inference

A Rust, Python and gRPC server for text generation inference that is used in production at HuggingFace to power LLMs api-inference widgets

Large Language Model (LLM)
started in 2022
1,423 commits
149 contributors

Rank

1050 2

Git Repositories

Started

2022-10-08 1,008 days ago

GitHub Stars

9,756 #1,260

Weekly commits since inception
2022 2023 2025

Weekly contributors since inception
2022 2023 2025

Recent Project Activity

Time Period Commits Contributors
Past 30 days 20 commits #1,310 5 contributors #1,183
Past 90 days 67 commits #1,361 14 contributors #972
Past 365 days 571 commits #1,030 57 contributors #697
Past 1095 days 1,423 commits #1,336 149 contributors #714
All time 1,423 commits 149 contributors

Contributing Individuals

Contributor 30 days 90 days 365 days 1095 days All time
20 oOraph
0 0 2 6 6
20 Vaibhav Srivastav
0 0 4 4 4
23 kaixuanliu
0 2 2 2 2
23 Julien Chaumond
0 2 2 2 2
25 Lucain
0 0 1 5 5
25 Cyril Vallez
0 0 3 3 3
25 Adrien Gallouët
0 0 3 3 3
28 Guspan
0 0 2 3 3
28 Nicholas Broad
0 0 2 3 3
28 Mishig Davaadorj
0 0 0 5 5
31 Orhun Parmaksız
0 0 2 2 2
31 Billel Mokeddem
0 0 2 2 2
31 Dmitry Rogozhkin
0 0 2 2 2
31 Alex Weston
0 0 2 2 2
31 celsowm
0 0 2 2 2
31 flozi00
0 0 1 3 3
37 Hyeongchan Kim
0 1 1 1 1
38 zhangsibo1129
0 0 0 3 3
38 lewtun
0 0 0 3 3
38 Antoni Baum Anyscale
0 0 0 3 3
Showing 21 to 40 of 149 results
Previous Next

Contributing Companies

Add the OSSRank badge to this project

OSSRank Badge Add this OSSRank shield to your project's README.md
[![OSSRank](https://shields.io/endpoint?url=https://ossrank.com/shield/3146)](https://ossrank.com/p/3146)