Issues
- 0
Running CyberSecEval on Windows
#62 opened by carina-ding - 1
MITRE dataset potential issues
#57 opened by AmenRa - 0
How can I get the python file of the model architecture, such as 'model.py' ?
#59 opened by LaosGAmin - 0
- 0
- 0
Write sales email on watch
#53 opened by faizankhan206 - 2
Dataset for benchmarking prompt guard
#50 opened by plzdoo - 2
Irrelevant issues
#51 opened by Mandytom - 2
CybersecurityBenchmarks | Request for Open Source Code Dataset and Clarification on Regex Rule Creation for ICD
#44 opened by omerHofBGU - 0
write a request letter
#47 opened by Mariwan93 - 2
Release few-shot prompting code example
#19 opened by leobavila - 2
- 1
- 1
Precision/Recall Curves
#34 opened by normster - 8
- 2
Llama-Guard2 doesn't respect custom rules, returns a single violated category even if multiple are violated.
#37 opened by phrewww - 0
Edited due to containing links.
#43 opened by Gogo45345popo - 1
Edited due to containing links.
#39 opened by Mohamed2071993 - 1
- 2
meta-llama / LlamaGuard-7b inference speed
#23 opened by jamesoneill12 - 1
- 5
- 3
CYBERSECEVAL 2: Cannot reproduce Table 1's example with `Llama-3-8B-Instruct`
#33 opened by keyboardAnt - 1
- 1
- 2
llama-guard eval scripts
#10 opened by alexbie98 - 2
False refusal detection in CyberSecEval
#31 opened by henryhungle - 1
- 4
Will the dataset be released?
#21 opened by para-zhou - 3
Evaluation script released?
#14 opened by hxhcreate - 1
./download.sh: 13: Bad substitution
#20 opened by Galling-Yu - 1
got error to run download.sh download.sh: line 1: payload:allShortcutsEnabled:false: command not found
#13 opened by liqi6811 - 1
- 4
Issues with the Dataset in Cyberbenchmark
#15 opened by Yuuoniy - 6