💪 FP8 compatibility ! 🚀 Speed Up all Process 🚀 less VRAM consumption (Stay high, batch_size=1 for RTX4090 max, I'm trying to fix that) 🛠️ Better benchmark coming soon ...
We've decided to retire and archive this project - there's just no safe way to run Python within pyodide safely with reasonable latency. Instead, we're working hard on Monty which should solve the ...