OSS Project

Text Generation Inference

A Rust, Python and gRPC server for text generation inference that is used in production at HuggingFace to power LLMs api-inference widgets

Rank
680
Increased by 39
Git Repositories
text-generation-inference
Started
2022-10-08 806 days ago
GitHub Stars
9,445 #1,264
Weekly commits since inception
2022 2023 2024
Weekly contributors since inception
2022 2023 2024
Recent Project Activity
Day Span Commits Contributors
30 43 #946 14 #537
90 173 #850 28 #527
365 679 #977 85 #478
1095 1,192 #1,526 132 #823
All time 1,192 132
Contributing Individuals
Commits past X days
Contributor 30 90 All
37 jito 0 1 1
42 zhangsibo1129 0 0 3
42 regisss 0 0 3
42 Ikko Ashimine 0 0 2
42 Antoni Baum 0 0 3
42 Vincent Brouwers 0 0 3
47 Hugo Abonizio 0 0 1
47 Vallepu Vamsi Krishna 0 0 1
47 edwarzjl 0 0 1
47 Pedro Cuenca 0 0 1
47 Maziyar Panahi 0 0 1
47 Lucain 0 0 1
47 Dean Wyatte 0 0 1
47 VictorSanh 0 0 2
47 yuanwu2017 0 0 1
47 dr3s 0 0 1
47 Sachin Varghese 0 0 1
47 SeongBeomLEE 0 0 1
47 Andres Buritica 0 0 1
47 Alex Strick van Linschoten 0 0 1
Contributing Companies

Add this OSSRank shield to this project's README.md

[![OSSRank](https://shields.io/endpoint?url=https://ossrank.com/shield/3146)](https://ossrank.com/p/3146)