vLLM: servindo LLMs no Linux com alta vazão — história, instalação e primeiros passos

vLLM: serving LLMs on Linux with high throughput — history, installation, and first steps

If you have run a local LLM with Ollama or llama.cpp, you know it works very well — for one or two people. When demand becomes an API that must handle dozens of simultaneous requests, the situation changes: the GPU sits idle waiting, memory becomes fragmented, and throughput plummets. That is precisely the problem … Read more

Data Science na vida real (GruPy-SP)

Data Science in real life (GruPy-SP)

On October 24, 2015, GruPy-SP (with InteropMIX) heard Fabio Franco Costa discuss data science without slides promising “you will be a scientist in three months.” The argument fits in one sentence: data science is a method for thinking about problems, not a stack. The video is on the LinuxPro channel. Below is the talk’s message — … Read more