nat.dev is a website that allows you to race AI models against each other.

Tens of thousands of people have used the site and it has become one of the most useful tools for comparing LLMs.

It all started with a Replit Bounty posted by @natfriedman 🧵

@natfriedman Nat wanted to build an AI model playground that could compare LLMs from different companies.

With a lot on his plate, he needed some curious hackers to help him bring it to life so he posted a Bounty to Replit.

@natfriedman A few days after posting, applications flowed in.

But one application was hard to ignore…

It was @iamzainhuda who came to Twitter to post an initial prototype.

@natfriedman @iamzainhuda After Zain was accepted, another developer Alexander Lourenco joined the project.

The team hit the ground running and quickly implemented model comparison for @OpenAI, @AnthropicAI, @huggingface, and other top LLMs.

@natfriedman @iamzainhuda @OpenAI @AnthropicAI @huggingface Demand for this tool and “free GPT” was so strong that the team quickly had to implement rate limiting to the website.

@natfriedman @iamzainhuda @OpenAI @AnthropicAI @huggingface Today, the playground code is open source so the community can continue to create new versions with new models as they are released.

@natfriedman @iamzainhuda @OpenAI @AnthropicAI @huggingface Want to bring your own idea to life?

Find a developer and kick things off today on Replit Bounties!

replit.com/bounties