Text Generation Inference

A Rust, Python and gRPC server for text generation inference that is used in production at HuggingFace to power LLMs api-inference widgets

Rank

672 68

Git Repositories

text-generation-inference

Started

2022-10-08 913 days ago

GitHub Stars

9,756 #1,261

Weekly commits since inception

2022 2023 2025

Weekly contributors since inception

2022 2023 2025

Recent Project Activity

Past 30 days 43 commits #1,009 16 contributors #468
Past 90 days 162 commits #928 27 contributors #571
Past 365 days 733 commits #899 83 contributors #481
Past 1095 days 1,354 commits #1,389 145 contributors #739
All time 1,354 commits 145 contributors

Contributing Individuals

Commits past X days
30 90 365 1095 All
95 Vince Jankovics 0 0 0 1 1
95 thomasw21 0 0 0 1 1
95 杨博 (Yang Bo) 0 0 0 1 1
95 Maxime Laboissonniere 0 0 0 1 1
95 Yannic Kilcher 0 0 0 1 1
95 dconathan 0 0 0 1 1
95 Dean Wyatte 0 0 0 1 1
95 sayf eddine hammemi 0 0 0 1 1
95 Lucain 0 0 0 1 1
95 Pedro Cuenca 0 0 0 1 1
95 Ehsan M. Kermani 0 0 0 1 1
95 Robert Kimball 0 0 0 1 1
95 Aastha Varma 0 0 0 1 1
95 Victor Muštar 0 0 0 1 1
95 Diwank Singh Tomer 0 0 0 1 1
95 SeongBeomLEE 0 0 0 1 1
95 Sai Vinay G 0 0 0 1 1
95 Hugo Abonizio 0 0 0 1 1
95 Dong Shin 0 0 0 1 1
95 Xin Yang 0 0 0 1 1
Showing 101 to 120 of 145 results Previous Next
Contributing Companies

Add this OSSRank shield to this project's README.md

[![OSSRank](https://shields.io/endpoint?url=https://ossrank.com/shield/3146)](https://ossrank.com/p/3146)