GLUE

CoLA下载

Data Format

Each line in the .tsv files consists of 4 tab-separated columns.
Column 1: the code representing the source of the sentence.
Column 2: the acceptability judgment label (0=unacceptable, 1=acceptable).
Column 3: the acceptability judgment as originally notated by the author.
Column 4: the sentence.

Corpus Sample

clc95	0	*	In which way is Sandy very anxious to see if the students will be able to solve the homework problem?
c-05	1		The book was written by John.
c-05	0	*	Books were sent to each other by the students.
swb04	1		She voted for herself.
swb04	1		I saw that gas can explode.

 

• 1
• 2
• 3
• 4
• 5

SST下载

sentence        label
a stirring , funny and finally transporting re-imagining of beauty and the beast and 1930s horror films 1
apparently reassembled from the cutting-room floor of any given daytime soap .  0
they presume their audience wo n't sit still for a sociology lesson , however entertainingly presented , so they trot out the conventional science-fiction elements of bug-eyed monsters and futuristic women in skimpy clothes . 0

 

• 1
• 2
• 3
• 4

SST-5：

4,"a stirring , funny and finally transporting re-imagining of beauty and the beast and 1930s horror films"
1,apparently reassembled from the cutting-room floor of any given daytime soap .
1,"they presume their audience wo n't sit still for a sociology lesson , however entertainingly presented , so they trot out the conventional science-fiction elements of bug-eyed monsters and futuristic women in skimpy clothes ."
2,the entire movie is filled with deja vu moments .

 

• 1
• 2
• 3
• 4

MRPC下载
MRPC(The Microsoft Research Paraphrase Corpus，微软研究院释义语料库)，相似性和释义任务，是从在线新闻源中自动抽取句子对语料库，并人工注释句子对中的句子是否在语义上等效。类别并不平衡，其中68%的正样本，所以遵循常规的做法，报告准确率（accuracy）和F1值。

样本个数：训练集3, 668个，开发集408个，测试集1, 725个。

任务：是否释义二分类，是释义，不是释义两类。

评价准则：准确率（accuracy）和F1值。

Quality	#1 ID	#2 ID	#1 String	#2 String
1	702876	702977	Amrozi accused his brother , whom he called " the witness " , of deliberately distorting his evidence .	Referring to him as only " the witness " , Amrozi accused his brother of deliberately distorting his evidence .

 

• 1
• 2

STSB下载

index	genre	filename	year	old_index	source1	source2	sentence1	sentence2	score
0	main-captions	MSRvid	2012test	0001	none	none	A plane is taking off.	An air plane is taking off.	5.000
1	main-captions	MSRvid	2012test	0004	none	none	A man is playing a large flute.	A man is playing a flute.	3.800
2	main-captions	MSRvid	2012test	0005	none	none	A man is spreading shreded cheese on a pizza.	A man is spreading shredded cheese on an uncooked pizza.	3.800

 

• 1
• 2
• 3
• 4

MNLI下载

index   promptID        pairID  genre   sentence1_binary_parse  sentence2_binary_parse  sentence1_parse sentence2_parse sentence1       sentence2       label1  gold_label
0       31193   31193n  government      ( ( Conceptually ( cream skimming ) ) ( ( has ( ( ( two ( basic dimensions ) ) - ) ( ( product and ) geography ) ) ) . ) )      ( ( ( Product and ) geography ) ( ( are ( what ( make ( cream ( skimming work ) ) ) ) ) . ) )     (ROOT (S (NP (JJ Conceptually) (NN cream) (NN skimming)) (VP (VBZ has) (NP (NP (CD two) (JJ basic) (NNS dimensions)) (: -) (NP (NN product) (CC and) (NN geography)))) (. .)))    (ROOT (S (NP (NN Product) (CC and) (NN geography)) (VP (VBP are) (SBAR (WHNP (WP what)) (S (VP (VBP make) (NP (NP (NN cream)) (VP (VBG skimming) (NP (NN work)))))))) (. .)))   Conceptually cream skimming has two basic dimensions - product and geography.     Product and geography are what make cream skimming work.        neutral neutral

 

• 1
• 2

QNLI下载

index   question        sentence        label
0       When did the third Digimon series begin?        Unlike the two seasons before it and most of the seasons that followed, Digimon Tamers takes a darker and more realistic approach to its story featuring Digimon who do not reincarnate after their deaths and more complex character development in the original Japanese.       not_entailment
1       Which missile batteries often have individual launchers several kilometres from one another?    When MANPADS is operated by specialists, batteries may have several dozen teams deploying separately in small sections; self-propelled air defence guns may deploy in pairs.      not_entailment
2       What two things does Popper argue Tarski's theory involves in an evaluation of truth?   He bases this interpretation on the fact that examples such as the one described above refer to two things: assertions and the facts to which they refer. entailment

 

• 1
• 2
• 3
• 4

RTE下载

index   sentence1       sentence2       label
0       No Weapons of Mass Destruction Found in Iraq Yet.       Weapons of Mass Destruction Found in Iraq.      not_entailment
1       A place of sorrow, after Pope John Paul II died, became a place of celebration, as Roman Catholic faithful gathered in downtown Chicago to mark the installation of new Pope Benedict XVI.      Pope Benedict XVI is the new leader of the Roman Catholic Church. entailment
2       Herceptin was already approved to treat the sickest breast cancer patients, and the company said, Monday, it will discuss with federal regulators the possibility of prescribing the drug for more breast cancer patients.        Herceptin can be used to treat breast cancer.   entailment

 

• 1
• 2
• 3
• 4

WNLI下载

index   sentence1       sentence2       label
0       I stuck a pin through a carrot. When I pulled the pin out, it had a hole.       The carrot had a hole.  1
1       John couldn't see the stage with Billy in front of him because he is so short.  John is so short.       1
2       The police arrested all of the gang members. They were trying to stop the drug trade in the neighborhood.       The police were trying to stop the drug trade in the neighborhood.      1
3       Steve follows Fred's example in everything. He influences him hugely.   Steve influences him hugely.    0

 

• 1
• 2
• 3
• 4
• 5