Text Generation Inference

A Rust, Python and gRPC server for text generation inference that is used in production at HuggingFace to power LLMs api-inference widgets

Rank

685 51

Git Repositories

text-generation-inference

Started

2022-10-08 910 days ago

GitHub Stars

9,756 #1,261

Weekly commits since inception

2022 2023 2025

Weekly contributors since inception

2022 2023 2025

Recent Project Activity

Past 30 days 39 commits #1,059 16 contributors #481
Past 90 days 155 commits #959 26 contributors #603
Past 365 days 728 commits #902 83 contributors #479
Past 1095 days 1,347 commits #1,395 145 contributors #739
All time 1,347 commits 145 contributors

Contributing Individuals

Commits past X days
30 90 365 1095 All
41 Ruida Zeng 0 1 1 1 1
41 Sadra Barikbin 0 1 1 1 1
41 lazariv 0 1 1 1 1
41 Nikolai Kolodziej 0 1 1 1 1
41 Dmitry Dygalo 0 1 1 1 1
46 lewtun 0 0 0 3 3
46 abhishek thakur 0 0 1 2 2
46 Vincent Brouwers 0 0 0 3 3
46 Antoni Baum 0 0 0 3 3
46 zhangsibo1129 0 0 0 3 3
46 regisss 0 0 0 3 3
46 Ikko Ashimine 0 0 1 2 2
53 edwarzjl 0 0 1 1 1
53 Torsten Raudssus 0 0 1 1 1
53 Aritra Roy Gosthipaty 0 0 1 1 1
53 Travis Addair 0 0 1 1 1
53 VictorSanh 0 0 0 2 2
53 Maziyar Panahi 0 0 1 1 1
53 dr3s 0 0 1 1 1
53 Alex Strick van Linschoten 0 0 1 1 1
Showing 41 to 60 of 145 results Previous Next
Contributing Companies

Add this OSSRank shield to this project's README.md

[![OSSRank](https://shields.io/endpoint?url=https://ossrank.com/shield/3146)](https://ossrank.com/p/3146)