Team Members
Description
Running edge LLMs in postmarketOS using llama.cpp
with optimization. This can be used as a feasibility study to study how many tokens can be generated per second.
Issues & PRs Board
No issues or pull requests added.