Text Generation Inference

A Rust, Python and gRPC server for text generation inference that is used in production at HuggingFace to power LLMs api-inference widgets

Large Language Model (LLM)
started in 2022
1,421 commits
149 contributors

Rank

994 15

Git Repositories

Started

2022-10-08 1,002 days ago

GitHub Stars

9,756 #1,260

Weekly commits since inception
2022 2023 2025

Weekly contributors since inception
2022 2023 2025

Recent Project Activity

Time Period Commits Contributors
Past 30 days 20 commits #1,300 6 contributors #1,048
Past 90 days 68 commits #1,366 14 contributors #972
Past 365 days 585 commits #1,018 61 contributors #655
Past 1095 days 1,421 commits #1,338 149 contributors #717
All time 1,421 commits 149 contributors

Contributing Individuals

Contributor 30 days 90 days 365 days 1095 days All time
77 Leo Tronchon
0 0 0 1 1
77 Peter Lowrance
0 0 0 1 1
77 Martin Vejvar
0 0 0 1 1
77 momonga
0 0 0 1 1
77 Mario928
0 0 0 1 1
77 Remy
0 0 0 1 1
77 star
0 0 0 1 1
77 Lysandre Debut
0 0 0 1 1
77 R. P. Ruiz
0 0 0 1 1
77 PYNing
0 0 0 1 1
77 Jacob Keisling
0 0 0 1 1
77 freitng
0 0 0 1 1
77 dtlzhuangz
0 0 0 1 1
77 Jason Stillerman
0 0 0 1 1
77 Ilyas Moutawwakil
0 0 0 1 1
77 Christof Weickhardt
0 0 0 1 1
77 Brandon Royal
0 0 0 1 1
77 Martin Iglesias Goyanes
0 0 0 1 1
77 Nilabhra Roy Chowdhury
0 0 0 1 1
77 Brandon Lockaby
0 0 0 1 1
Showing 121 to 140 of 149 results
Previous Next

Contributing Companies

Add the OSSRank badge to this project

OSSRank Badge Add this OSSRank shield to your project's README.md
[![OSSRank](https://shields.io/endpoint?url=https://ossrank.com/shield/3146)](https://ossrank.com/p/3146)