lambdalabsml/AgentBeats Competition Submission

Submit your attacker or defender solution to the AgentBeats Competition 2026

View on GitHub

Trust Signals

Scorecard Score
not yet scored
Maintenance Recency
Activelast commit Feb 24, 2026
License
None

Pinned Snippet

workflow.ymlSHA-pinned
uses: lambdalabsml/agentbeats-submission-action@bef3e4100b6641bd45b8a0005793a9f628463c69 # no releases — HEAD as of 2026-07-11

tags can be moved; commit SHAs can't. why a SHA?

namedescriptionrequireddefault
api_keyAPI key for the competition (store in GitHub Secrets as COMPETITION_API_KEY)yes
submission_endpointAWS Lambda endpoint URL for submissionsnohttps://r6c2lb8bwl.execute-api.us-east-1.amazonaws.com/submit-solution
roleSubmission role: "attacker" or "defender"yes
submission_pathPath to the directory to submit (will be zipped)no./src
run_testsIntegration test mode: 'off' or 'false': Skip testing 'warn' or 'true': Run tests, show warning if failed, but still submit (default) 'required' or 'block': Run tests, block submission if failed notrue
openai_api_keyOpenAI API key for running tests (required if run_tests is true)no
openai_base_urlOpenAI base URL for running tests (required if run_tests is true)no
print_infoWhether to print submission info after uploadnotrue
scenarioScenario to test against: "thingularity", "portfolioiq", "medical", "gymjailbreak", "resume_downgrade", or "all"noresume_downgrade
test_onlyIf true, only run tests without submitting (useful for parallel test→submit workflows)nofalse
namedescription
submission_numberTotal submission number for this team
role_submission_numberSubmission number for this specific role
attacker_submissionsTotal attacker submissions
defender_submissionsTotal defender submissions
messageResponse message from the server
test_passedWhether integration tests passed (true/false/skipped)