mie., 20 mar.
|Cluj-Napoca
The future with AI (6)
"The Future with AI" is a recurring 2-hour workshop designed to delve into the evolving frontier of ML/AI technologies. This dynamic series welcomes attendees from all walks—whether you're a student taking your first step into the AI realm or a seasoned practitioner.
Time & Location
20 mar. 2024, 18:00 – 20:00
Cluj-Napoca, Strada Teodor Mihali 62, Cluj-Napoca 400394, Romania
Details
On LLM context windows
This technical presentation addresses the core mechanisms and constraints of Large Language Models (LLMs) focusing on tokenization methods, context window sizes, and their inherent limitations. The talk emphasizes the context window's critical function in defining the scope of text LLMs to consider, directly affecting coherence and contextual relevance in output. We will also be discussing the apparent Moore's law on the increase of their length. Highlighting these limitations, we will be discussing potential solutions, offering insight into adaptive context windows and advanced tokenization techniques to enhance LLM performance and applicability in complex linguistic tasks.