Home Creators Posts Import Register Favorites Logout

Downloads

Content

This is part 2 of my investigation into Rabbit, where we take a turn to a more recent project that suffers similar problems to "GAMA".

Overhyped, underdelivering, I bought an R1 myself to go down the rabbit hole and figure out if a "new foundational model" was all it was cracked up to be.

It wasn't great. Jesse Lyu (CEO of Rabbit) denied an interview at multiple points, although the offer is still on the table.

Files

Rabbit Gaslit Me, So I Dug Deeper

Support: ► Patreon: https://patreon.com/coffeezilla Follow: ► Twitter: @coffeebreak_yt ► Instagram: @coffeebreak_yt Credits: 3D Artist: Ed Leszczynski @LeszczynskiEd Video Editor: Harry Bagg @HarryRBagg End Credits Composer: Claire Wickes @clairewritesmusic Camera Motion Tracking: Mo-Sys Startracker https://www.mo-sys.com/product/camera-tracking/startracker/ Virtual Production Platform: Aximmetry https://aximmetry.com/ This video is an opinion and in no way should be construed as statements of fact. Scams, bad business opportunities, and fake gurus are subjective terms that mean different things to different people. I think someone who promises $100K/month for an upfront fee of $2K is a scam. Others would call it the "opportunity of a lifetime."

Comments

Jonathan Rivera

Man I was hooked on the first video, btw I still keep trying to find my name on the credits and no luck yet it’s like finding Waldo 🥲

Tinni

If I recall MKHB's review only the concept of the LAM excited him. If it doesn't exist, why have Rabbit!

Hamza H

They make users type login/password combinations and store them in their servers. I would be very curious to know what is the process they put in place to secure those passwords. Do they have one single encryption key for all users ?

David Weintraub

A few people have gotten the Rabbit R1 to run on a standard Android phone. There could be some differences due to system permission issues. The Rabbit’s launcher app is installed as a root app. An Android install on a typical smart phone won’t get that permission. Still, the videos do show it doing many of the tasks as the official rabbit device — no LAM needed https://www.androidauthority.com/rabbit-r1-is-an-android-app-3438805/

angelfacepeanut

Hell yeah! The more content, the merrier. And as someone who has been watching people call rabbit out over the past couple of weeks, this two-part series has been another incredible deep dive into an incredibly shady business. Phenomenal job man! Hope you're doing well man, excited to see all the projects you have in store.

Eric Aidinovich

Hype Coffee!! I’m really DIGGING this series so far :)

The Last Scientist

I am enjoying the shift away from crypto. Is the codebase for rabbit available on Github?

Calvin

I don’t understand how anyone can watch that Rabbit R1 ad and think that they’re gonna an AI that is better than anything Google, Apple, and Samsung has developed at the low price of $200. A random Chinese company is somehow better than billion dollar tech companies trying to figure how to do this right now. Sure… The people who bought this are chumps…

Brian Gibson

So basically, you aren't going along with their marketing grift so that's not good. 😂 Sign of the times with most corporations these days.

Harry Moore

Coffee, I think you misunderstood the point of Patreon. Was said to collect our donos... you're out here collecting W's

Tamir

I was on the fence for this product until I saw the huge picture of a lock. I had no idea they took privacy so seriously. Respect!

Hex

Your investigative work is great, but I'd love to see more analysis of the evidence in these cases and applicable laws to determine the (alleged) likelihood of legal liability. I know its not realistic to make every video a collab with someone like Legal Eagle, but I always feel like I'm left wondering what, if any, consequences the subjects of your investigations might face given the evidence you discover. Awesome content though! I've only ever subbed to a handful of Patreons, and yours is well worth it. =)

TigerHix

Awesome investigation, as always! A few things that I would like to mention, as someone reasonably familiar with this field: 1) Their claim that Rabbit is "faster than chat assistant apps like ChatGPT" might not be completely false, but it's a shady claim. OpenAI's API access to its GPT models, in many cases, *are* faster than the ChatGPT web app (accessed by non-developers). Of course, this doesn't change the fact that Rabbit is just a poor ChatGPT wrapper. 2) The concept of Rabbit's "Large Action Model" and Jesse Lyu's explanation of it is most likely inspired by WebArena (https://webarena.dev/), a benchmark to evaluate the web-browsing capabilities of LLMs. I attended a LLM agent workshop earlier this month, and the most recent results using GPT-4V (the state-of-the-art vision model) only achieved less than 30% accuracy on all the tasks. Keep in mind that those tasks (click through a few pages on a fake Amazon) are much simpler than the ones Rabbit claims to solve (booking Uber rides, ordering DoorDash, solving captchas, etc.). Knowing this alone, people should already be highly skeptical of Rabbit's "Large Action Model". 3) Theoretically, it makes sense to combine a tool like Playwright with a LLM to automate tasks. This is just like ChatGPT's function calling feature, e.g., it "browses the web" by invoking an external tool (that is not ChatGPT itself), which returns the webpage as a string, so that ChatGPT can process it. So, if Rabbit's "LAM", which is at best a finetuned/prompted vision LM that knows how to invoke external tools, can generate correct, *contextual* interaction instructions for Playwright, then Rabbit's claims may have some credibility (at least this is what academia is currently trying to achieve!). Note this is indeed different from Playwright's codegen, which generates static code that doesn't adopt to both the conversation context and the webpage's UI changes. But again, likely Jesse doesn't know what he's talking about, and Rabbit doesn't seem to have their own vision LM at all. 4) In the conclusion you mentioned Rabbit is "ChatGPT with an auto-clicker" - you are actually praising Rabbit too much! LLM researchers are trying very hard to make "ChatGPT with an auto-clicker" happen by improving LLM's web parsing capabilities :) Rabbit is more like "ChatGPT for answering questions, and Playwright scripts for using apps".

Brian Gibson

Another angle of theirs. Victim status. If we refuse to give you our side we can say you never gave our side. Scamological.

/// _

I really have to wonder if what they are doing can fall into bypassing API limitations of these app companies for their product- I feel like they might not have consulted with these companies before pushing their product to store

Kilrah

Did you look into the ties between Rabbit and Teenage engineering? Apparently it's also not a "coincidence", but shared board member(s)

Jumure

Is the LAM in the room with us right now? 👀👀👀

Elizabeth Woodley

I love the commercial remake! Great way to show the extent of the over-promises, and also your interactions with the rabbit are hysterical 😂

DaMu

I'm glad you reenacted the entire commercial of how Rabbit was demonstrated only to show how broken it is.

JBones RVA

Scary how many psychopaths there are out there who say and do anything with no hesitation or shame just to make money. Thanks for making us all more aware Mr. Coffeezilla!

Stephen Ford

2 years from now Coffee’s career will have completely pivoted from crypto related scams to AI ones.

Ant Wakefield

How freaking stupid do u have to be to try and hoodwink coffezilla?!? History shows it never ends well…

Brandon

Itching for the next video….

Ross Vincent

"I'm not gonna answer your questions because the answers would be so technical you just wouldn't get it, bro."

Mithurshun Jeyatharan

Awesome investigation. I wanted to ask you Coffee. In the world of entrepreneurship there is a term called Minimum Viable Product (MVP) which serves to understand the market, whether or not anybody will buy your product. Is it possible that the Rabbit is just a MVP and now that they have a proof-of-concept the real product can now be build?

Chazzaroo

Your eyes at "The DoorDash app is under maintenance" sent me, I am howling.

Zero

The guy made such a smart move, just lie sell a plastic square with screen, profit.

Lil_Ellie

I was not even halfway through this and started wondering about security and data privacy. Is this company selling user information? I'd assume you'd need to login to all of your accounts on those apps which gives them a lot of information about the user. I could be incorrect about users being required to login to the apps.

Osman M

To be super honest though, a *lot* of startups start off like this. Get the basic thing working, prove the concept, then refine it. OpenAI itself was the same way — they trained their models on copyrighted data, aiming to produce “value,” with legal concerns being punted down the line. Rabbit is bad but not as blatantly fraudulent as those startups with fake users (and there are a lot). I think they need about 1 more year of development time before being close to doing what was advertised. And that also includes contractual negotiations with the API service providers (DoorDash, Uber, etc). The guy’s mistake was launching too early and calling it “production ready” when it should’ve been more like a very early access private beta.

SeeBiscuit

So happy you remembered your password! 🧡

Angie aka Mrs_Cuddelsworth

I would have laughed so hard if rabbit had said “get your lazy ass up and make breakfast yourself”