> open-source models with up to 120 billion parameters
Sad, 120b models are definetely feasible to self-host. I'd be more interested in cloud providers (especially one with computational resources like the Schwartz group) hosting the larger 500B+ models. Probably just too expensive/unsustainable if one could 5x fold the cost by serving smaller models solving the needs of the 90% customer.
> open-source models with up to 120 billion parameters
Sad, 120b models are definetely feasible to self-host. I'd be more interested in cloud providers (especially one with computational resources like the Schwartz group) hosting the larger 500B+ models. Probably just too expensive/unsustainable if one could 5x fold the cost by serving smaller models solving the needs of the 90% customer.