LoRA pay-per-token hosting seems harder to find
An app needs an LLM adjusted for its own specific use case. The plan was to use a service such as Together AI or Fireworks to run a LoRA and pay only for the tokens used.
Those services no longer appear to offer the same pricing for LoRA s that they once did. Clear online information about the change is hard to find.
Usage will be sporadic over the next few months while the app is tested, so renting a GPU full time is too expensive. The main need is the cheapest way to host a model with a .
Key points
- The app needs an LLM tailored to one specific use case.
- Together AI and Fireworks were considered for LoRA hosting.
- options for LoRA s now seem hard to find.
- Full-time GPU rental does not fit sporadic testing over the next few months.
- The open question is the cheapest way to host a model with a .