BROADCASTS.com

The exponentially growing **AI/ML** and **LLMs** advancements bring concerns about privacy, as there is a risk of data exposure to online LLMs service providers. Setting up **LLMs in-house** requires a **high computational cost** which is a major obstacle for businesses across various sectors such as Retail, Healthcare, Finance, etc. These industries seek to leverage the power of LLMs to drive **profitability** in their overall\nbusiness while maintaining **control over their data.**\n\nIn this session, we will explore the **Edge Ecosystem Analytics** and its transformative potential in **GenAI Applications**. Through seamless orchestration via **Rancher managed Kubernetes** which can help individuals overcome challenges in adopting and deploying cutting edge Gen-AI applications at the edge.\n\nKey Topics:\n\n- Overview of **Large Language Models (LLMs)**\n- Scope for **Edge Computing** in AI revolution\n- Benefits over privacy concerns by **localization of LLMs**\n- Real-world Application Showcase by leveraging **GenAI for Edge Ecosystem Analytics**\n- Integration of Retrieval Augmentation Generation (RAG) Pipeline into **Rancher & K3s**\n- Challenges while deploying **GenAI applications at the Edge**\n\nThis short talk will showcase a real-world GenAI-based application, highlighting the utilization of the RAG pipeline as well as a **data modeling pipeline** to continually improve analytic outputs and its seamless integration with **Rancher and K3s**. Attendees would learn about Rancher, K3s in managing Kubernetes deployments for GenAI applications, LLMs optimizations techniques such as **RAG,** overview of **Fine Tuning** and \n **AI Agents.**\n\n\nThe exponentially growing **AI/ML** and **LLMs** advancements bring concerns about privacy, as there is a risk of data exposure to online LLMs service providers. Setting up **LLMs in-house** requires a **high computational cost** which is a major obstacle for businesses across various sectors such as Retail, Healthcare, Finance, etc. These industries seek to leverage the power of LLMs to drive **profitability** in their overall\nbusiness while maintaining **control over their data.**\n\nIn this session, we will explore the **Edge Ecosystem Analytics** and its transformative potential in **GenAI Applications**. Through seamless orchestration via **Rancher managed Kubernetes** which can help individuals overcome challenges in adopting and deploying cutting edge Gen-AI applications at the edge.\n\nKey Topics:\n\n- Overview of **Large Language Models (LLMs)**\n- Scope for **Edge Computing** in AI revolution\n- Benefits over privacy concerns by **localization of LLMs**\n- Real-world Application Showcase by leveraging **GenAI for Edge Ecosystem Analytics**\n- Integration of Retrieval Augmentation Generation (RAG) Pipeline into **Rancher & K3s**\n- Challenges while deploying **GenAI applications at the Edge**\n\nThis short talk will showcase a real-world GenAI-based application, highlighting the utilization of the RAG pipeline as well as a **data modeling pipeline** to continually improve analytic outputs and its seamless integration with **Rancher and K3s**. Attendees would learn about Rancher, K3s in managing Kubernetes deployments for GenAI applications, LLMs optimizations techniques such as **RAG,** overview of **Fine Tuning** and \n **AI Agents.**\n\nabout this event: https://c3voc.de