Text Generation Inference

A Rust, Python and gRPC server for text generation inference that is used in production at HuggingFace to power LLMs api-inference widgets

Large Language Model (LLM)
started in 2022
1,424 commits
149 contributors

Rank

1157 166

Git Repositories

Started

2022-10-08 1,015 days ago

GitHub Stars

9,756 #1,260

Weekly commits since inception
2022 2023 2025

Weekly contributors since inception
2022 2023 2025

Recent Project Activity

Time Period Commits Contributors
Past 30 days 9 commits #1,692 4 contributors #1,308
Past 90 days 56 commits #1,457 13 contributors #1,013
Past 365 days 554 commits #1,045 56 contributors #705
Past 1095 days 1,424 commits #1,336 149 contributors #712
All time 1,424 commits 149 contributors

Contributing Individuals

Contributor 30 days 90 days 365 days 1095 days All time
37 Guillaume LEGENDRE
0 0 0 3 3
37 Aaron Mihalik
0 0 0 3 3
37 zhangsibo1129
0 0 0 3 3
44 Hyeongchan Kim
0 0 1 1 1
44 ssmi153
0 0 0 2 2
44 jito
0 0 1 1 1
44 zspo
0 0 0 2 2
44 Torsten Raudssus
0 0 1 1 1
44 Aritra Roy Gosthipaty
0 0 1 1 1
44 Sadra Barikbin
0 0 1 1 1
44 abhishek thakur
0 0 0 2 2
44 Travis Addair Predibase
0 0 1 1 1
44 Corentin REGAL
0 0 1 1 1
44 Vallepu Vamsi Krishna
0 0 1 1 1
44 VictorSanh
0 0 0 2 2
44 Nikolai Kolodziej
0 0 1 1 1
44 Ikko Ashimine
0 0 0 2 2
44 Shaltiel Shmidman
0 0 1 1 1
44 Dmitry Dygalo
0 0 1 1 1
44 Alex Strick van Linschoten ZenML
0 0 1 1 1
Showing 41 to 60 of 149 results
Previous Next

Contributing Companies

Add the OSSRank badge to this project

OSSRank Badge Add this OSSRank shield to your project's README.md
[![OSSRank](https://shields.io/endpoint?url=https://ossrank.com/shield/3146)](https://ossrank.com/p/3146)