Text Generation Inference

A Rust, Python and gRPC server for text generation inference that is used in production at HuggingFace to power LLMs api-inference widgets

started in 2022
1,372 commits
146 contributors

Rank

809 122

Git Repositories

Started

2022-10-08 936 days ago

GitHub Stars

9,756 #1,261

Weekly commits since inception

2022 2023 2025

Weekly contributors since inception

2022 2023 2025

Recent Project Activity

Time Period Commits Contributors
Past 30 days 26 commits #1,223 9 contributors #807
Past 90 days 123 commits #1,090 22 contributors #687
Past 365 days 697 commits #924 77 contributors #519
Past 1095 days 1,372 commits #1,379 146 contributors #738
All time 1,372 commits 146 contributors

Contributing Individuals

Contributor 30 days 90 days 365 days 1095 days All time
0 0 1 1 1
0 0 1 1 1
48 jito
0 0 1 1 1
48 ssmi153
0 0 0 2 2
48 ur4t
0 0 1 1 1
0 0 1 1 1
0 0 1 1 1
0 0 1 1 1
0 0 1 1 1
0 0 1 1 1
0 0 1 1 1
0 0 1 1 1
0 0 1 1 1
0 0 1 1 1
48 Jeff
0 0 1 1 1
0 0 1 1 1
0 0 1 1 1
0 0 1 1 1
0 0 1 1 1
0 0 1 1 1
Showing 61 to 80 of 146 results

Contributing Companies

Add the OSSRank badge to this project

OSSRank Badge Add this OSSRank shield to your project's README.md
[![OSSRank](https://shields.io/endpoint?url=https://ossrank.com/shield/3146)](https://ossrank.com/p/3146)