Practical Strategies for Optimizing LLM Inference Sizing and Performance | NVIDIA Technical Blog
Practical Strategies for Optimizing LLM Inference Sizing and Perform…
Aug 21, 2024
nvidia.com
EfficientML.ai Lecture 12 - Transformer and LLM (Part I) (MIT 6.5940, Fall 2023)
1:17:49
EfficientML.ai Lecture 12 - Transformer and LLM (Part I) (MIT …
11.1K viewsOct 20, 2023
YouTubeMIT HAN Lab
Intelligent LLM inferencing via vLLM Semantic Router, LLM-D with local and cloud LLMs | Sanjeev Rampal
Intelligent LLM inferencing via vLLM Semantic Router, LLM-D with loca…
1.6K views2 months ago
linkedin.com
EfficientML.ai Lecture 12 - Transformer and LLM (Part I) (MIT 6.5940, Fall 2023, Zoom)
1:19:54
EfficientML.ai Lecture 12 - Transformer and LLM (Part I) (MIT …
4.4K viewsOct 20, 2023
YouTubeMIT HAN Lab
EfficientML.ai Lecture 12 - Transformer and LLM (Part I) (MIT 6.5940, Fall 2023)
1:19:37
EfficientML.ai Lecture 12 - Transformer and LLM (Part I) (MIT …
3K viewsOct 22, 2023
bilibiliMIT-HAN-LAB
Lec 12 | Efficient LLMs: Part 02
1:01:46
Lec 12 | Efficient LLMs: Part 02
452 views4 months ago
YouTubeLCS2
What is LLM Inference?
1:00
What is LLM Inference?
219 views9 months ago
YouTubeCodersArts
52:54
LLMs | Efficient LLM Decoding-II | Lec15.2
1.8K viewsOct 9, 2024
YouTubeLCS2
54:05
LLMs | Efficient LLM Decoding-I | Lec15.1
2.3K viewsOct 4, 2024
YouTubeLCS2
35:00
The inner workings of LLMs explained - VISUALIZE the self-att…
14.1K viewsMay 13, 2023
YouTubeDiscover AI
12:52
LLM Inference Explained: How AI Predicts Tokens and How to Make …
1 views2 months ago
YouTubeBinary Verse AI
33:39
Mastering LLM Inference Optimization From Theory to Cost …
31.7K viewsJan 1, 2025
YouTubeAI Engineer
34:14
Understanding the LLM Inference Workload - Mark Moyou, NVIDIA
22K viewsOct 1, 2024
YouTubePyTorch
6:28
LLM in a flash: Efficient Large Language Model Inference with Li…
4.8K viewsDec 23, 2023
YouTubeAI Papers Academy
53:35
Yuandong Tian | Efficient Inference of LLMs with Long Context Support
1.2K viewsDec 8, 2023
YouTubeLondon Machine Learning Meetup
36:12
Deep Dive: Optimizing LLM inference
44.6K viewsMar 11, 2024
YouTubeJulien Simon
6:14
Rules of Inference - Basic Terminology
259.4K viewsMay 30, 2018
YouTubeNeso Academy
18:17
How to use open source LLM model | Free | Groq | Faster Inference
1.2K viewsApr 2, 2024
YouTubeNextGenAI with Sai
1:17
Efficient LLM inference solution on Intel GPU
722 viewsJan 18, 2024
bilibiliPaperWeekly
55:39
Understanding LLM Inference | NVIDIA Experts Deconstruct How …
21.2K viewsApr 23, 2024
YouTubeDataCamp
45:11
LLM inference optimization: Model Quantization and Distillation
1.2K viewsSep 22, 2024
YouTubeYanAITalk
1:13:27
CMU LLM Inference (1): Introduction to Language Models and Inference
3K views5 months ago
YouTubeGraham Neubig
5:42
Distributed LLM inferencing across virtual machines using vLLM and …
571 views7 months ago
YouTubeBalakrishnan B
36:43
Primer on LLM Inference: Optimization with Prefill and Decode
218 views4 months ago
YouTubeAI Papers Podcast Daily
31:36
An Introduction to the Inner Workings of LLM Inference Engines
144 views3 months ago
YouTube
1:20
Demo: Efficient FPGA-based LLM Inference Servers
1.8K viewsNov 7, 2024
YouTubeAltera
40:53
Infinite-LLM: Efficient LLM Service for Long Context with DistAttentio…
461 viewsJan 8, 2024
YouTubeArxiv Papers
5:16
LLM System Design Interview: How to Optimise Inference Latency
239 views2 months ago
YouTubePeetha Academy
9:05
Modern LLM Inference: Architecture, Quantization, and Serving Infrastr…
11 views1 month ago
YouTubeUplatz
10:13
2.1. Tutorial on LLM evaluation methods. Overview and Basic API.
2.2K views9 months ago
YouTubeEvidently AI
See more videos
Static thumbnail place holder