Text Generation Inference

A Rust, Python and gRPC server for text generation inference that is used in production at HuggingFace to power LLMs api-inference widgets

Large Language Model (LLM)
started in 2022
1,365 commits
145 contributors

Rank

800 122

Git Repositories

Started

2022-10-08 923 days ago

GitHub Stars

9,756 #1,261

Weekly commits since inception
2022 2023 2025

Weekly contributors since inception
2022 2023 2025

Recent Project Activity

Time Period Commits Contributors
Past 30 days 24 commits #1,291 9 contributors #803
Past 90 days 144 commits #997 22 contributors #702
Past 365 days 723 commits #898 80 contributors #499
Past 1095 days 1,365 commits #1,380 145 contributors #738
All time 1,365 commits 145 contributors

Contributing Individuals

Contributor 30 days 90 days 365 days 1095 days All time
21 Lucain
0 0 4 5 5
22 Vaibhav Srivastav
0 0 4 4 4
22 Adrien
0 0 4 4 4
24 celsowm
0 2 2 2 2
25 Nicholas Broad
0 0 3 3 3
25 Guillaume LEGENDRE
0 0 3 3 3
27 Alex Weston
0 1 2 2 2
28 Guspan
0 0 2 3 3
28 Mishig Davaadorj
0 0 0 5 5
28 Corentin REGAL
1 1 1 1 1
31 Dmitry Rogozhkin
0 0 2 2 2
31 Luc Georges
0 0 2 2 2
31 icyboy™
0 0 2 2 2
31 flozi00
0 0 1 3 3
31 Moritz Laurer
0 0 2 2 2
31 Aaron Mihalik
0 0 1 3 3
31 Orhun Parmaksız
0 0 2 2 2
31 Billel Mokeddem
0 0 2 2 2
39 Sadra Barikbin
0 1 1 1 1
39 Nikolai Kolodziej
0 1 1 1 1
Showing 21 to 40 of 145 results
Previous Next

Contributing Companies

Add the OSSRank badge to this project

OSSRank Badge Add this OSSRank shield to your project's README.md
[![OSSRank](https://shields.io/endpoint?url=https://ossrank.com/shield/3146)](https://ossrank.com/p/3146)