Self-hosting & scaling models

Published: Oct. 31, 2023, 6 p.m.

b'We\\u2019re excited to have Tuhin join us on the show once again to talk about self-hosting open access models. Tuhin\\u2019s company Baseten specializes in model deployment and monitoring at any scale, and it was a privilege to talk with him about the trends he is seeing in both tooling and usage of open access models. We were able to touch on the common use cases for integrating self-hosted models and how the boom in generative AI has influenced that ecosystem.'