Comparison of AI Chatbots

I was working on a consulting job I'm currently involved with. I wanted META-descriptions for SEO. So I thought I'd put it into ChatGPT and let it generate one based on the blog text.

Since I was going to do this with multiple texts, I started by writing:

"Act as an SEO copywriter. I will send you a text. Can you take that text and rewrite it as a meta description? That is, max 160 characters and with a CTA."

One thing worth noting is that the first time I didn't write "Act as an SEO copywriter" and the response was significantly worse. I just want to emphasize the importance of context and persona for the LLM to arrive at a good answer. But often I'm lazy and don't bother writing a perfect prompt.

Note that all models are used in their free version.

The text I sent in was:

"What is the drivetrain on a bicycle? The drivetrain on a bicycle is something we often have to explain to our customers when they bring their bike in for service at the workshop. The drivetrain is simply explained as "what drives forward" and refers to the technical components that drive a system in a vehicle forward. Even with that explanation, it might not be entirely clear what is meant and perhaps even less why parts of the drivetrain, or maybe even the entire drivetrain needs to be replaced. More about that when we go through below which components are included in the drivetrain of a bicycle and how they work together to drive the bicycle forward."

TLDR: Winner: Mistral with 4 stars

ChatGPT, Deepseek, Mistral, Grok, or Gemini? Which was the best LLM?

ChatGPT 4.0

Response: "The bicycle drivetrain consists of chain, cassette, and crankset – everything that drives the bike forward. Read more about how it works and when it should be replaced! 🚴‍♂️"

Character count: 149

Response time: 3 sec

My rating: ⭐⭐⭐

Conclusion: Okay response, okay response time, okay word count, so a rating accordingly. Good character count. Emojis? No thanks.

Deepseek v3

Response: "Discover what the drivetrain on a bicycle is and why it's important for your cycling performance. Learn which parts are included and when they need replacement. Book service today for a smooth cycling experience! 🚴‍♂️"

Character count: 196

Response time: 12 seconds

My rating: ⭐

Conclusion: Deepseek was by far the slowest and didn't really complete the task at all, as it was supposed to stay within 160 characters. Also getting tired of all the emojis from LLMs. The text was okay.

Mistral - Le chat

Response:

"Discover what the bicycle drivetrain is and why it's crucial. Read more and learn about the components here!"

Character count: 119

Response time: Less than 1 sec.

My rating: ⭐⭐⭐⭐

Conclusion: This is the first time I'm testing Mistral and I'm positively surprised. The response was by far the fastest and the text is actually really good! It also stayed within 160 characters but perhaps a bit on the low side with 119.

Grok 3

Response:

"Read about the bicycle drivetrain – the parts that drive you forward! Get clarity and book service with us now. (95 characters)"

Character count: 96 (according to character counter and when I counted)

Response time: 3 sec.

My rating: ⭐⭐

Conclusion: Grok gets minus points for very few words and for counting wrong. The text wasn't really good either.

Google Gemini Flash

Response:

"Unsure about the bicycle drivetrain? We clarify the concept and explain its important parts. Learn more about maintenance and replacement. Read the guide now!"

Character count: 133

Response time: 2.5 sec.

My rating: ⭐⭐⭐

Conclusion: Mediocre response, good character count, and normal response time.

This is a small test, with a very short prompt. But I will definitely test Mistral more!

Links:

• ChatGPT

• DeepSeek

• Mistral

• Grok

• Gemini