Text Generation Inference

A Rust, Python and gRPC server for text generation inference that is used in production at HuggingFace to power LLMs api-inference widgets

Rank

829 143

Git Repositories

text-generation-inference

Started

2022-10-08 922 days ago

GitHub Stars

9,756 #1,261

Weekly commits since inception

2022 2023 2025

Weekly contributors since inception

2022 2023 2025

Recent Project Activity

Past 30 days 29 commits #1,215 8 contributors #910
Past 90 days 151 commits #968 22 contributors #701
Past 365 days 723 commits #904 80 contributors #500
Past 1095 days 1,364 commits #1,381 145 contributors #738
All time 1,364 commits 145 contributors

Contributing Individuals

Commits past X days
30 90 365 1095 All
94 A.J 0 0 0 1 1
94 CL-Shang 0 0 0 1 1
94 Adam Kowalski 0 0 0 1 1
94 cdawg 0 0 0 1 1
94 Adarsh Shirawalmath 0 0 0 1 1
94 Jae-Won Chung 0 0 0 1 1
94 ivarflakstad 0 0 0 1 1
94 sawan Rawat 0 0 0 1 1
94 王佳欣 0 0 0 1 1
94 xiaobin 0 0 0 1 1
94 Leo Tronchon 0 0 0 1 1
94 Peter Lowrance 0 0 0 1 1
94 Martin Vejvar 0 0 0 1 1
94 momonga 0 0 0 1 1
94 Mario928 0 0 0 1 1
94 Remy 0 0 0 1 1
94 star 0 0 0 1 1
94 R. P. Ruiz 0 0 0 1 1
94 PYNing 0 0 0 1 1
94 Jacob Keisling 0 0 0 1 1
Showing 121 to 140 of 145 results Previous Next
Contributing Companies

Add this OSSRank shield to this project's README.md

[![OSSRank](https://shields.io/endpoint?url=https://ossrank.com/shield/3146)](https://ossrank.com/p/3146)