Text Generation Inference

A Rust, Python and gRPC server for text generation inference that is used in production at HuggingFace to power LLMs api-inference widgets

Rank

688 45

Git Repositories

text-generation-inference

Started

2022-10-08 911 days ago

GitHub Stars

9,756 #1,261

Weekly commits since inception

2022 2023 2025

Weekly contributors since inception

2022 2023 2025

Recent Project Activity

Past 30 days 36 commits #1,086 15 contributors #499
Past 90 days 155 commits #956 26 contributors #597
Past 365 days 728 commits #902 83 contributors #478
Past 1095 days 1,347 commits #1,394 145 contributors #739
All time 1,347 commits 145 contributors

Contributing Individuals

Commits past X days
30 90 365 1095 All
53 Jeff 0 0 1 1 1
53 KevinDuffy94 0 0 1 1 1
53 sunxichen 0 0 1 1 1
53 icyboy™ 0 0 1 1 1
53 vinkamath 0 0 1 1 1
53 Javier Martinez 0 0 1 1 1
53 SeongBeomLEE 0 0 1 1 1
53 Adrien 0 0 1 1 1
53 almersawi 0 0 1 1 1
53 Martin Iglesias Goyanes 0 0 1 1 1
53 Ikram Ul Haq 0 0 1 1 1
53 jp 0 0 1 1 1
53 RodriMora 0 0 1 1 1
53 janne-alatalo 0 0 1 1 1
95 Andres Buritica 0 0 0 1 1
95 Jelle Zijlstra 0 0 0 1 1
95 Julien Bouquillon 0 0 0 1 1
95 Pasquale Minervini 0 0 0 1 1
95 Sachin Varghese 0 0 0 1 1
95 Traun Leyden 0 0 0 1 1
Showing 81 to 100 of 145 results Previous Next
Contributing Companies

Add this OSSRank shield to this project's README.md

[![OSSRank](https://shields.io/endpoint?url=https://ossrank.com/shield/3146)](https://ossrank.com/p/3146)