Text Generation Inference

A Rust, Python and gRPC server for text generation inference that is used in production at HuggingFace to power LLMs api-inference widgets

started in 2022
1,368 commits
146 contributors

Rank

754 76

Git Repositories

Started

2022-10-08 924 days ago

GitHub Stars

9,756 #1,261

Weekly commits since inception

2022 2023 2025

Weekly contributors since inception

2022 2023 2025

Recent Project Activity

Time Period Commits Contributors
Past 30 days 27 commits #1,232 11 contributors #667
Past 90 days 147 commits #980 23 contributors #662
Past 365 days 724 commits #897 81 contributors #497
Past 1095 days 1,368 commits #1,379 146 contributors #735
All time 1,368 commits 146 contributors

Contributing Individuals

Contributor 30 days 90 days 365 days 1095 days All time
11 60 219 363 363
0 0 26 360 360
1 20 159 159 159
4 drbh
0 5 101 134 134
2 9 48 49 49
4 8 14 14 14
1 6 11 11 11
0 6 10 10 10
0 0 11 15 15
0 5 9 9 9
2 5 7 7 7
1 1 8 8 8
0 4 4 4 4
0 0 2 11 11
0 0 0 13 13
0 0 0 13 13
2 2 2 3 3
17 oOraph
1 1 2 6 6
0 3 3 3 3
0 3 3 3 3
Showing 1 to 20 of 146 results

Contributing Companies

Add the OSSRank badge to this project

OSSRank Badge Add this OSSRank shield to your project's README.md
[![OSSRank](https://shields.io/endpoint?url=https://ossrank.com/shield/3146)](https://ossrank.com/p/3146)