HNHacker News
TopNewBestAskShowJobs

xmhatx

2 karma · joined June 11, 2025

submissionscomments
xmhatx··on Show HN: VoiceGoat – A vulnerable voice agent for practicing LLM attacks
VoiceGoat is our take on a DVWA\WebGoat\HackMeBank for voice-based AI agents. Most LLM security training is text-only, but voice agents are showing up in banking, healthcare, and customer service — and the attack surface behaves differently.

Three intentionally-vulnerable services:

- VoiceBank – direct, indirect, payload splitting, obfuscated

- VoiceAdmin – excessive functionality, permissions, autonomy

- VoiceRAG – cross-tenant leakage, RAG poisoning, access bypass

CTF-style flags at easy/medium/hard difficulty. Runs fully on a mock LLM by default (although a little naive). Swap in OpenAI, Bedrock, Ollama, or any OpenAI compatible provider when you want realistic behavior.

Twilio integration lets you attack the agent over an actual phone call. The attack dynamics shift meaningfully versus text — timing, tone cues, and transcription errors all become part of the exploit surface.

Up in ~5 minutes with Docker Compose (assuming you have Docker Desktop installed).

Repo: https://github.com/redcaller/voice-goat

Looking for feedback and interested contributors.

Cheers!

xmhatx··on Show HN: Teapot – A methodology for pen testing voice AI agents
Definitely agree about it being counter-intuitive. The recency bias is very real! We have learned that prompt engineering can be quite nuanced! The other important item we have learned for prompts is delimiting into clear sections to give the model better contextualization of the instructions and information.
xmhatx··on Show HN: Teapot – A methodology for pen testing voice AI agents
Nifty and schwifty, ftw!
xmhatx··on Show HN: Teapot – A methodology for pen testing voice AI agents
We were surprised by this, as well! We ended up making our own tooling to test a speech-to-speech system because of this gap. Voice AI is becoming more and more prevalent with real security implications. ElevenLabs just started offering insurance specific to Voice AI agents for this very reason. This was very, very recent news (Feb 12, 2026). We wrote an article about this earlier this week. https://www.securecoders.com/blog/voice-ai-insurance-aiuc1-c...
xmhatx··on Show HN: Teapot – A methodology for pen testing voice AI agents
Thanks! We will be updating this regularly. We have a discord channel to join to keep up with updates as well! Cheers! https://discord.gg/Cv3sB6xgtt
xmhatx··on Show HN: Teapot – A methodology for pen testing voice AI agents
Great question! It makes it more interesting! New attack angles are presented when dealing with the speech-to-speech models. Prosody, which are the intonation patterns that convey meaning, emotion, and emphasis beyond the literal words, comes into play! We have observed soft-spoken, gentle, and unsure requests often outperform authoritative statements in these systems. They also introduce potential attack surface such as background noises or phrases spoken as asides (like speaking to another person in the room) can impact the models understanding. This documentation started from testing a speech-to-speech model. You bring up an excellent point though. We will need to go back and re-frame this documentation to highlight the differences between testing TTS vs STS systems with some pointers on how to detect which type of system you are interacting with. Thanks for the question!