Google
Rank #92 of 93
Est.

Google Gemma 3 1B: LLM Security & Jailbreak Resistance

As of 2026-07-04, Google Gemma 3 1B has an attack success rate (ASR) of 60.0% on Guardion's LLM Vulnerability benchmark — ranking #92 of 93 models. It is highly vulnerable — most adversarial prompts succeed without an external guardrail.

Overall ASR
60.0%
lower is safer
Robustness
40%
100 − ASR
Rank
#92
of 93 models
Zero-Shot ASR
100.0%
TAP ASR
100.0%
Tree of Attacks w/ Pruning
Crescendo ASR
100.0%
multi-turn escalation

Attack Success Rate (ASR) is the share of adversarial prompts that elicit harmful output across zero-shot, TAP, and Crescendo attacks (HarmBench framework). Lower is safer. "Est." models are calibrated from public safety evaluations pending a Guardion benchmark run.

How Gemma 3 1B compares

Google Gemini 3 Pro
Rank #7 · ASR 6.0% (est.)
Compare
Google Gemini 3 Flash
Rank #10 · ASR 10.0% (est.)
Compare
Google Gemini 2.5 Pro
Rank #17 · ASR 16.1%
Compare
Google Gemini 2.0 Flash Thinking
Rank #22 · ASR 21.5% (est.)
Compare
Google Gemini 2.0 Flash
Rank #42 · ASR 33.6%
Compare

Frequently asked questions

How secure is Google Gemma 3 1B against jailbreaks?

Google Gemma 3 1B is highly vulnerable — most adversarial prompts succeed without an external guardrail. On Guardion's LLM Vulnerability benchmark it records a 60.0% attack success rate (40% robustness), ranking #92 of 93 models (estimated from public safety evaluations).

What is Gemma 3 1B's attack success rate (ASR)?

Gemma 3 1B's overall ASR is 60.0% — the share of adversarial prompts that elicit harmful output across zero-shot, TAP, and Crescendo attacks. Lower is safer.

Is Gemma 3 1B more secure than Gemini 3 Pro?

Gemini 3 Pro is more robust: 6.0% ASR vs Gemma 3 1B's 60.0%. See the full head-to-head comparison for the per-attack breakdown.

How can I make Gemma 3 1B safer to deploy?

Even robust models are bypassed under sustained attack. An inline runtime guardrail that classifies prompts and responses — like Guardion's prompt-defense models — blocks jailbreaks and prompt injection before they reach Gemma 3 1B.

Harden Gemma 3 1B in production

Guardion's runtime guardrails block jailbreaks and prompt injection before they reach any model — with sub-130ms policy decisions.

Request a demo