To wydarzenie już się odbyło. Sprawdź nadchodzące wydarzenia
Cracking the Code: A Deep Dive into Open Source Language Model Deployment and Inference
Wydarzenie:
Cracking the Code: A Deep Dive into Open Source Language Model Deployment and Inference
Typ wydarzenia:
Spotkanie
Kategoria:
Tematyka:
Data:
16.02.2024 (piątek)
Godzina:
10:00
Język:
angielski
Wstęp:
Bezpłatne
Miasto:
Miejsce:
Online
Adres:
On-line
Zaloguj się, by zgłosić zmianę.
Prelegenci:
Opis:
This talk will include material on how we can utilize and perform inference on Open-Source Large Language Models (LLM) in different environments such as GPU instances and local machines effectively. It will also minimally include tradeoffs between open-source deployment on premises and closed-source services. We will go through deployment and creating REST APIs that users can interact with. It will include the comparison of tradeoffs between several frameworks as well.
