Subscribe
Sign in
Human or Not? — A social turing game by AI21 labs
Chat with someone for two minutes, and try to figure out if it was a fellow human being or an AI bot. You can end up talking with someone random, or with GPT-4 / Jurassic-2 / Claude or other state of the art LLMs. Think you can tell the difference?
70
Replies
Hey Hunters! :)
My name is Amos and I work at AI21 Labs. A few months ago I had a cool idea: what if we would create a text-based chatroulette-style game that matches humans with AI bots, and after a few messages you get to guess if you’re talking to another fellow player or an AI bot?
Well, our team decided to go ahead and build it, and here we are! I’m so f***ing excited to share this cool new web game and AI experiment called “Human or Not?” with the community. It’s a “social Turing game” that lets you find out if you can tell the difference between an AI and a human.
So how does it work? The system randomly connects you to either an AI bot or another human like yourself playing the game. During a two minute chat you can ask or talk about whatever you want. Once the conversation ends, you have to choose, and only then the game reveals the truth - if that was an AI or another player. The bots are based on all the latest and greatest models: our very own Jurassic-2, as well as GPT-4, Claude and other LLMs.
The game is free to play, and its goal is just to help all of us better understand the nature of these AI models in the context of not just a productivity tool, but members of our online world.
We hope this will be a weird, crazy, thought provoking and mostly funny experience, and we would love for the Product Hunt community to be among the first to play with it. We are curious to see which strategies you will choose in order to expose the bot/human in the game. We would also appreciate any feedback, and if you liked the game - help us spread the word around! :)
Thanks so much!
Amos & the team
Game is cool, but there are some dead giveaways (like - only humans don't finish their sentences in time and so on).
It would be nice if there were some additional points if you manage to fool the other side.
So people would try to sound like an AI, which would make it harder to guess.
Or even better - points should be only for fooling the other side, not for guessing correctly. It would be nice if you could experiment with that I think.
@pawel_stryczniewicz Great ideas! We were actually thinking exactly about that idea as another phase of the project. Hopefully we'll get to that soon. BTW - bots don't finish their sentences as well sometimes, beware not to be fooled ;)
@cata Thanks so much Nick! There are endless "characters" you can encounter if you're are indeed talking to an AI bot, and they vary on many different variables, one of which is the LLM behind it. There is a mix of of those, including Jurassic-2, GPT-4 and others.
That's so much fun 😅 Unfortunately too much fun, because I can't get enough 😂 @amos_meron
Whoa! What a nice game. I played this game around 10 times, and many times I was wrong in selecting Human or bot, but I really enjoyed it. The best thing about this is, the clean UI, and kept it so simple that you can use it without any how-to guide!
Just played a round - asked the other side "should I buy bitcoin?" and got the response "What is bitcoin?" - such a dead giveaway... c'mon humans, you can do better!
@assaf_dudai @tee_dubs Thanks Tarryn! There are actually a lot of different bots and different LLMs in the game's pool, so you're welcome to try a few more games. If you keep winning it might be a good sign for mankind 😅
Challenge accepted! This feels like Chat Roulette for 2023—I love it!
@matthew_ritchie Exactly. Thank god AI doesn't do real-time fake video very well. Yet 🫣
Such a cool idea! Please tell me why you didn't call it "bot or not" instead of "human or not"!
@saeedzti Thanks Saeed! We wanted to put the emphasis on human part - can you tell if you're talking to a human?
The game has actually beaten me. 😅
I thought I was chatting with a robot, and it turned out I just talked to a human. 🤔
This is actually interesting and in these times where AI is really shaping our lives, it's even more interesting.
Human or Not?