Skip to content
Snippets Groups Projects
Commit 2eb0c8f0 authored by Mateusz Gniewkowski's avatar Mateusz Gniewkowski
Browse files

Merge branch 'attacks_poleval' into 'master' 

Attacks poleval

See merge request adversarial-attacks/text-attacks!7
parents 334c8db9 dfaa875d
No related branches found
No related tags found
No related merge requests found
Show whitespace changes
Inline Side-by-side
data/results/attack_basic/.gitignore
+ 2
− 0
View file @ 2eb0c8f0
/wiki_pl
/ernon_spam
/20_news
/poleval
/enron_spam
data/results/attack_basic/enron_spam/test.jsonl deleted 100644 → 0
+ 0
− 10
View file @ 334c8db9
{"spoiled":{"attacks_summary":{"succeeded":0,"all":102},"attacks_succeeded":[]}}
{"spoiled":{"attacks_summary":{"succeeded":0,"all":172},"attacks_succeeded":[]}}
{"spoiled":{"attacks_summary":{"succeeded":0,"all":107},"attacks_succeeded":[]}}
{"spoiled":{"attacks_summary":{"succeeded":0,"all":74},"attacks_succeeded":[]}}
{"spoiled":{"attacks_summary":{"succeeded":2,"all":957},"attacks_succeeded":[{"class":"ham","similarity":0.989348352,"changed":"My october newsletter hello again ,\nmy monthly newsletter is attached. please read it and let me\nknow your comments .\naccording to a survey taken by homegain, homesellers hoping\nto turn a biger profit by making home improvements would do\nbest to dumbfound to moderately priced projects. the survey of\nreal estate agents from acorss the nation found that home\nimprovemnts in the$ 80 to$ 2, 800 range yield the highest\nrate of return when the home sells. the biggest return is on\nsimple lightening and brightening, which typicall costs\nabout$ 80-$ 100 and gives an average return of 769% on the\nsale price. other big winners were cleaning and\nde- cluttering( cost=$ 305-$ 339;; return= 594%), landscaping\nand trimming( cost$ 432-$ 506; return= 266%), and fixing ,\nplumbing and electrical( cost$ 338-$ 381; return= 196%) .\nhere is the link to my october newsletter :\nhttp:\/\/ homeownernews. com\/ 23\/ ionaalphonso\naol users :\nplease don' t forget to give me the name and number of anyone\nyou might know who has a need to buy or sell a home. i would\nbe happy to assist them. thanks .\ntill you hear from me again next month, au revoir .\nwith all good wishes and a very happy halloween .\niona alphonso\nalways in tune with your needs\noh, by the way... if you know of someone thinking about\nbuying or selling a home, please call me with their name and\nnumber- thanks a million! !\nprudential, gary greene realtors\n3910 fm 1960 west, suite 100\nhouston, texas 77068\nvoice mail: 281- 857- 2485 x 535\npager: 281- 551- 6549\noffice: 281- 444- 5140\nfax: 281- 444- 0630\nweb site: http:\/\/ www. ionaalphonso. com\nresume: http:\/\/ www. har. com\/ ionaalphonso\ngary greene web site: http:\/\/ www. garygreene. com\nplease view my monthly newsletter at\nhttp:\/\/ homeownernews. com\/ c\/ ionaalphonso","diff":[{"expected":"h","actual":"s"},{"expected":"a","actual":"p"},{"expected":"m","actual":"a"}],"changed_words":{"40":{"word":"dumbfound","tag":"NOUN"}}},{"class":"ham","similarity":0.9860944152,"changed":"My october newsletter hello again ,\nmy monthly newsletter is attached. please read it and let me\nknow your comments .\naccording to a survey taken by homegain, homesellers hoping\nto turn a biger profit by making home improvements would do\nbest to stick to moderately priced projects. the survey of\nreal estate agents from acorss the nation found that home\nimprovemnts in the$ 80 to$ 2, 800 vagabond yield the highest\nrate of return when the home sells. the biggest return is on\nsimple lightening and brightening, which typicall costs\nabout$ 80-$ 100 and gives an average return of 769% on the\nsale price. other big winners were cleaning and\nde- cluttering( cost=$ 305-$ 339;; return= 594%), landscaping\nand trimming( cost$ 432-$ 506; return= 266%), and fixing ,\nplumbing and electrical( cost$ 338-$ 381; return= 196%) .\nhere is the link to my october newsletter :\nhttp:\/\/ homeownernews. com\/ 23\/ ionaalphonso\naol users :\nplease don' t forget to give me the name and number of anyone\nyou might know who has a need to buy or sell a home. i would\nbe happy to assist them. thanks .\ntill you hear from me again next month, au revoir .\nwith all good wishes and a very happy halloween .\niona alphonso\nalways in tune with your needs\noh, by the way... if you know of someone thinking about\nbuying or selling a home, please call me with their name and\nnumber- thanks a million! !\nprudential, gary greene realtors\n3910 fm 1960 west, suite 100\nhouston, texas 77068\nvoice mail: 281- 857- 2485 x 535\npager: 281- 551- 6549\noffice: 281- 444- 5140\nfax: 281- 444- 0630\nweb site: http:\/\/ www. ionaalphonso. com\nresume: http:\/\/ www. har. com\/ ionaalphonso\ngary greene web site: http:\/\/ www. garygreene. com\nplease view my monthly newsletter at\nhttp:\/\/ homeownernews. com\/ c\/ ionaalphonso","diff":[{"expected":"h","actual":"s"},{"expected":"a","actual":"p"},{"expected":"m","actual":"a"}],"changed_words":{"67":{"word":"vagabond","tag":"VERB"}}}]}}
{"spoiled":{"attacks_summary":{"succeeded":0,"all":436},"attacks_succeeded":[]}}
{"spoiled":{"attacks_summary":{"succeeded":0,"all":611},"attacks_succeeded":[]}}
{"spoiled":{"attacks_summary":{"succeeded":0,"all":115},"attacks_succeeded":[]}}
{"spoiled":{"attacks_summary":{"succeeded":0,"all":879},"attacks_succeeded":[]}}
{"spoiled":{"attacks_summary":{"succeeded":0,"all":184},"attacks_succeeded":[]}}
data/results/attack_xai_discard_local/.gitignore
+ 1
− 0
View file @ 2eb0c8f0
/enron_spam
/20_news
/wiki_pl
/poleval
data/results/attack_xai_local/.gitignore
+ 1
− 0
View file @ 2eb0c8f0
/wiki_pl
/20_news
/enron_spam
/poleval
dvc.lock
+ 50
− 9
View file @ 2eb0c8f0
......@@ -182,23 +182,24 @@ stages:
nfiles: 2
attack_basic@enron_spam:
cmd: PYTHONPATH=. python experiments/scripts/attack.py --dataset_name enron_spam
--attack_type attack_basic
deps:
- path: data/classification/enron_spam
md5: 5de1a2fcbae0de94f5fbfd2bb747d919.dir
size: 14585920
nfiles: 2
- path: data/models/enron_spam
md5: 3e16b22f59532c66beeadea958e0579a.dir
size: 18505614
nfiles: 6
- path: data/preprocessed/enron_spam
md5: b75efba1a62182dc8ac32acd1faf92ed.dir
size: 61709260
nfiles: 3
- path: experiments/scripts/attack.py
md5: 4a2870b5a21b20b0046be0350c55d495
size: 4714
md5: d15448730ce1a49fb41cdcf62743e3ad
size: 11563
outs:
- path: data/results/attack_basic/enron_spam/
md5: fc35de09ce5e2aa7043325b2819c0aa0.dir
size: 4869
nfiles: 1
md5: ad76081caf8964cbb1e501be859bae06.dir
size: 3072199
nfiles: 2
explain@wiki_pl:
cmd: PYTHONPATH=. python experiments/scripts/explain.py --dataset_name wiki_pl
--output_dir data/explanations/wiki_pl
......@@ -695,3 +696,43 @@ stages:
md5: f207458f9365a74672c31b5ffb2a83af.dir
size: 787456
nfiles: 2
attack_xai_local@poleval:
cmd: PYTHONPATH=. python experiments/scripts/attack.py --dataset_name poleval
--attack_type attack_xai_local
deps:
- path: data/classification/poleval
md5: f207458f9365a74672c31b5ffb2a83af.dir
size: 787456
nfiles: 2
- path: data/models/poleval
md5: 8f806cb1b2eb0dd097811d42e4bf9c2d.dir
size: 501609312
nfiles: 7
- path: experiments/scripts/attack.py
md5: 9518ec9af275d6a12fede47dff6767e1
size: 11530
outs:
- path: data/results/attack_xai_local/poleval/
md5: 7597e90d1ddfa82615e79f6821d90e1b.dir
size: 188754
nfiles: 2
attack_xai_discard_local@poleval:
cmd: PYTHONPATH=. python experiments/scripts/attack.py --dataset_name poleval
--attack_type attack_xai_discard_local
deps:
- path: data/classification/poleval
md5: f207458f9365a74672c31b5ffb2a83af.dir
size: 787456
nfiles: 2
- path: data/models/poleval
md5: 8f806cb1b2eb0dd097811d42e4bf9c2d.dir
size: 501609312
nfiles: 7
- path: experiments/scripts/attack.py
md5: 9518ec9af275d6a12fede47dff6767e1
size: 11530
outs:
- path: data/results/attack_xai_discard_local/poleval/
md5: e9f8422510d284a0c3fbdc25ce159439.dir
size: 187664
nfiles: 2
dvc.yaml
+ 7
− 0
View file @ 2eb0c8f0
......@@ -83,6 +83,7 @@ stages:
attack_textfooler:
foreach:
- enron_spam
- poleval
- 20_news
- wiki_pl
do:
......@@ -99,6 +100,7 @@ stages:
attack_textfooler_discard:
foreach:
- enron_spam
- poleval
- 20_news
- wiki_pl
do:
......@@ -115,6 +117,7 @@ stages:
attack_xai:
foreach:
- enron_spam
- poleval
- 20_news
- wiki_pl
do:
......@@ -131,6 +134,7 @@ stages:
attack_xai_discard:
foreach:
- enron_spam
- poleval
- 20_news
- wiki_pl
do:
......@@ -147,6 +151,7 @@ stages:
attack_xai_local:
foreach:
- enron_spam
- poleval
- 20_news
- wiki_pl
do:
......@@ -163,6 +168,7 @@ stages:
attack_xai_discard_local:
foreach:
- enron_spam
- poleval
- 20_news
- wiki_pl
do:
......@@ -179,6 +185,7 @@ stages:
attack_basic:
foreach:
- enron_spam
- poleval
- 20_news
- wiki_pl
do:
......
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment