Text Generation Inference

A Rust, Python and gRPC server for text generation inference that is used in production at HuggingFace to power LLMs api-inference widgets

Large Language Model (LLM)
started in 2022
1,400 commits
148 contributors

Rank

846 54

Git Repositories

Started

2022-10-08 967 days ago

GitHub Stars

9,756 #1,261

Weekly commits since inception
2022 2023 2025

Weekly contributors since inception
2022 2023 2025

Recent Project Activity

Time Period Commits Contributors
Past 30 days 23 commits #1,262 7 contributors #954
Past 90 days 108 commits #1,140 23 contributors #637
Past 365 days 667 commits #939 73 contributors #550
Past 1095 days 1,400 commits #1,353 148 contributors #724
All time 1,400 commits 148 contributors

Contributing Individuals

Contributor 30 days 90 days 365 days 1095 days All time
40 Sadra Barikbin
0 1 1 1 1
40 EachSheep
0 1 1 1 1
40 Corentin REGAL
0 1 1 1 1
40 jiqing-feng
0 1 1 1 1
45 Vincent Brouwers
0 0 0 3 3
45 Antoni Baum Anyscale
0 0 0 3 3
45 zhangsibo1129
0 0 0 3 3
45 lewtun
0 0 0 3 3
49 Ziru Niu
0 0 1 1 1
49 Vallepu Vamsi Krishna
0 0 1 1 1
49 Torsten Raudssus
0 0 1 1 1
49 Aritra Roy Gosthipaty
0 0 1 1 1
49 abhishek thakur
0 0 0 2 2
49 Travis Addair Predibase
0 0 1 1 1
49 VictorSanh
0 0 0 2 2
49 Nikolai Kolodziej
0 0 1 1 1
49 Ikko Ashimine
0 0 0 2 2
49 zspo
0 0 0 2 2
49 Dmitry Dygalo
0 0 1 1 1
49 Alex Strick van Linschoten ZenML
0 0 1 1 1
Showing 41 to 60 of 148 results
Previous Next

Contributing Companies

Add the OSSRank badge to this project

OSSRank Badge Add this OSSRank shield to your project's README.md
[![OSSRank](https://shields.io/endpoint?url=https://ossrank.com/shield/3146)](https://ossrank.com/p/3146)