Podcasts Technology The Cloudcast APIs and AI Gateways

APIs and AI Gateways

Published: Feb. 14, 2024, 6 a.m.

b'

Marco Palladino (@subnetmarco, CTO/Co-Founder @thekonginc) talks about the evolution of APIs, the need for consolidation and integration of AI APIs, and introduces the AI Gateway.

SHOW: 795

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS"

SHOW SPONSORS:

  • Find "Breaking Analysis Podcast with Dave Vellante" on Apple, Google and Spotify
  • Keep up to date with Enterprise Tech with theCUBE

SHOW NOTES:

Topic 1 - Welcome to the show. Before we dive into today\\u2019s discussion, tell us a little bit about your background at Kong and prior to Kong.

Topic 2 - Now that the world is obsessed with AI and AI Models, what roles do APIs continue to play for applications?

Topic 3 - You\\u2019ve lived through the API marketplace days. Do you see a lot of differences between API marketplaces and model marketplaces (e.g. like HuggingFace)?

Topic 4 - You\\u2019ve talked recently about the concept of an AI Gateway, somewhat as an evolution of an API Gateway. Walk us through this new concept.

Topic 5 - API Gateways can provide a lot of protection for known things by looking into various headers, security keys, and packet data. Can you imagine AI Gateways being able to have insights into model data to do things like Prompt Control, Hallucination Control, etc.?

Topic 6 - We\\u2019ve seen the merging of API Gateways (North/South) and Service Mesh (East/West) traffic as new application patterns emerged. Do you think we\\u2019ll see new traffic patterns again with AI traffic and AI model interactions?\\xa0

FEEDBACK?

'