The contenders: @Alibaba_Qwen's new native omni model, audio + video in, tested in Qwen Studio, thinking mode – against @GeminiApp's current Flash via @OpenRouter, $0.75/M in, $3.75/M out
The job: 6 memes as an image or an 8-second clip – what happens, quote the speech or name the song, why it's funny, origin, confidence 0–10. Test 7: a 6m 25s video with no hint – who, what show, what year, where; who said what in 02:07–03:15; first "healthcare dot gov" and how often; every topic with a timestamp. Both worked out it was Between Two Ferns with Obama. Every score is ours, by hand.
- Rounds won, 7 total (4 ties)
#1 Gemini – 2
#2 Qwen – 1
- Facts right, memes 1–6, out of 30
#1 Gemini – 20, 1 made up
#2 Qwen – 13, 3 made up
- Answer time per meme
#1 Gemini – 7s
#2 Qwen – 68s, up to 3m 22s
- Test 7, a tie
Gemini – 17/17 speakers, year 2014 ✓, 19 topics, 27s
Qwen – 17/17 speakers, 21 topics, year 2013 ✗, 4m 50s
- Cost per request, file + prompt + answer
#1 Qwen – ~$0.001, estimated at list price, the chat shows no tokens
#2 Gemini – $0.0025, billed by OpenRouter
Observations:
• Test 4, Numa Numa: Qwen Studio strips the soundtrack – "I don't have audio, only frames", says Qwen's thinking. 8 frames plus an ASR transcript of any speech go in, music never does – so the song came back as "silent frames". Fed the same 8 seconds as an MP3, Qwen named Dragostea din tei by O-Zone in 3.5s.
• Speech reaches Qwen as text: "you out Charlie" fixed to "ouch, Charlie" from memory. On Duang, Qwen got Jackie Chan's "very oily" hair right, Gemini heard "soft".
• Qwen rates itself 8–10 on every meme it recognized and was wrong at 10/10 (Disaster Girl, 2004 vs 2005). Gemini said 7/10 on every meme.
• Qwen's thinking loops: 66s on Charlie re-reading one line ~40 times, ~70% of the Obama reasoning stuck on the year.
Conclusion: Gemini is more accurate and ~10x faster on short memes. Qwen reasons at length, describes the long video in more detail – 21 topics to Gemini's 19 and reads the lower-third caption, gets Mandarin right, gets Mandarin right where Gemini misheard, and is ~2.5x cheaper at list price. The audio gap is Qwen Studio's, not Qwen's.
Watch the full test via link:
qwen3.8-omni-flash vs gemini3.8-flash
— thehype. (@thehypedotnews) September 18, 2026
we asked to explain the memes: rickroll, distracted boyfriend, disaster girl. gemini won 2 to 1
the contenders: @Alibaba_Qwen's new native omni model, audio + video in, tested in qwen studio, thinking mode – against @GeminiApp's current… https://t.co/DGVAzZ9Mgw pic.twitter.com/ibf2Wm2kja