Text Generation Inference

A Rust, Python and gRPC server for text generation inference that is used in production at HuggingFace to power LLMs api-inference widgets

Rank

650 103

Git Repositories

text-generation-inference

Started

2022-10-08 905 days ago

GitHub Stars

9,756 #1,261

Weekly commits since inception

2022 2023 2025

Weekly contributors since inception

2022 2023 2025

Recent Project Activity

Past 30 days 54 commits #865 18 contributors #438
Past 90 days 154 commits #945 26 contributors #598
Past 365 days 732 commits #902 83 contributors #483
Past 1095 days 1,346 commits #1,398 145 contributors #739
All time 1,346 commits 145 contributors

Contributing Individuals

Commits past X days
30 90 365 1095 All
21 Vaibhav Srivastav 0 0 4 4 4
21 Adrien 0 0 4 4 4
21 oOraph 0 0 3 5 5
24 Nicholas Broad 0 1 3 3 3
25 Alex Weston 1 1 2 2 2
26 Guspan 0 1 2 3 3
27 yuanwu2017 1 1 1 2 2
27 Guillaume LEGENDRE 0 0 3 3 3
29 Sadra Barikbin 1 1 1 1 1
29 Mishig Davaadorj 0 0 0 5 5
29 Corentin REGAL 1 1 1 1 1
29 EachSheep 1 1 1 1 1
29 jiqing-feng 1 1 1 1 1
34 icyboy™ 0 0 2 2 2
34 Luc Georges 0 0 2 2 2
34 Moritz Laurer 0 0 2 2 2
34 Aaron Mihalik 0 0 1 3 3
34 flozi00 0 0 1 3 3
34 Orhun Parmaksız 0 0 2 2 2
34 Dmitry Rogozhkin 0 0 2 2 2
Showing 21 to 40 of 145 results Previous Next
Contributing Companies

Add this OSSRank shield to this project's README.md

[![OSSRank](https://shields.io/endpoint?url=https://ossrank.com/shield/3146)](https://ossrank.com/p/3146)