NaN: the community's first month in numbers
117 billion tokens, 3.68 million requests, 21 countries, and 99.98% uptime. NaN is a community of builders with its own inference infrastructure and a private platform to deploy apps and agents.
AI
3 entradas
AI for Dummies - Part 1
In this post we'll learn what parameters and quantization are, so we can figure out how much space AI models take up.
How to set up an inference server to serve AI models
In this post I'll walk you through how the community's inference servers are set up: the hardware we use, the stack we run, and the models we serve.