Academic system

SwarmAttacker vs hackingBuddyGPT

A TU Wien research framework for building your own LLM security-testing agents in about fifty lines of Python, from privilege escalation to web and Active Directory.

Vendor
IPA-Lab, TU Wien
Licence
MIT
Pricing
Free. You pay your LLM provider or run local models.
Checked
September 2, 2026
CapabilitySwarmAttacker8 of 8hackingBuddyGPT4 of 8
FreeYes.
Runs on a ChatGPT subscriptionNot found.
Custom prompts & skillsYes.
Safety-refusal handlingNot found.
Parallel multi-agent swarmPartial.
MIT-licensed open sourceYes.
Black-box from a URLPartial.
Model-agnosticYes.
  • yes
  • not found or only partly

Hover a mark for the evidence. A cross means the capability was not found, or only partly found, on hackingBuddyGPT's public pages or repository on September 2, 2026, not that it is technically impossible.

Profile

What is hackingBuddyGPT?

hackingBuddyGPT is an MIT-licensed Python framework from TU Wien's IPA-Lab, led by Andreas Happe and Jürgen Cito, whose stated goal is helping ethical hackers use LLMs in fifty lines of code or less. Rather than a turnkey scanner, it supplies the plumbing: LLM connectivity through LiteLLM with OpenRouter as the default, SSH, shell and HTTP capabilities, run limits on rounds, tokens, dollars and wall-clock time, and structured traces, so researchers can write their own agents, which the project calls use-cases.

Shipped use-cases cover Linux and Windows privilege escalation with ground-truth root verification and a Docker-fleet benchmark launcher, three web-testing agents including one that delegates to bounded sub-agents, an OpenAPI-driven REST API tester, and an Active Directory assumed-breach agent built on a planner and executor design. The code base is fully asynchronous and requires Python 3.13 or newer.

Its evidence base is academic: a 2023 FSE paper, the 2026 Empirical Software Engineering article "LLMs as Hackers" with a twelve-machine privilege-escalation benchmark on which GPT-4-Turbo reached 33 to 83 percent against a human baseline of 75, and a December 2025 thesis that ran nine models through the web agents on two custom OWASP Top 10 applications, where Claude Sonnet 4.5 and GPT-5.1 found 77 to 81 percent of the flags. The web agents hunt configurable capture-the-flag markers and the documentation describes web testing as exploratory; cloud safety filters are acknowledged but not handled.

Development remains active, with commits in late August 2026 and around 1,200 stars, although the last tagged release dates from August 2024. The target users are security researchers and students building or benchmarking agents.

In SwarmAttacker's favour

Where it stands out.

  • 01Turnkey rather than a toolkit: SwarmAttacker takes a URL and produces findings; hackingBuddyGPT expects you to write and tune the agent first.
  • 02Runs on a ChatGPT Plus or Pro plan with no API key; hackingBuddyGPT requires a metered provider key.
  • 03Refusals are detected and recovered automatically instead of being left to the operator.
  • 04A planner that fans out parallel specialist attackers, where hackingBuddyGPT delegates sequentially to bounded sub-agents.

In hackingBuddyGPT's favour

Where it is stronger.

  • 01Breadth beyond web apps: Linux and Windows privilege escalation with ground-truth checks, REST API testing from OpenAPI specs and Active Directory assumed-breach scenarios.
  • 02Designed for experimentation: a minimal agent is a few dozen lines, with run limits, traces and a benchmark launcher built in.
  • 03Peer-reviewed publication record from FSE 2023 to Empirical Software Engineering 2026 and a public privilege-escalation benchmark.
  • 04Runs entirely locally on Ollama through LiteLLM.

Verdict

Which one should you pick?

Pick hackingBuddyGPT if you are a researcher or student who wants to build and measure your own agent, especially for privilege escalation or Active Directory. Pick SwarmAttacker if you want a working black-box web pentester today, with no API key to buy.

Turn a URL into a security report.

Open source, MIT licensed, and it runs on the ChatGPT plan you already pay for. Install it and point it at a target you own.

brew install joloooo/swarm/swarm
Source on GitHub