Since the generative models were not trained on speech data,
they are expected to generate unintelligible speech.
Therefore, please DO NOT consider the intelligibility of speech as a part of the criteria
(the voice quality can be taken into consideration).
Criteria for audio-text correspondence
The quality of each rating is:
5 - Excellent.
4 - Temporal mismatch or other slight mismatches.
E.g., the prompt says one sound after another, but the audio has them simultaneously.
3 - One of the sound components missing/redundant/incorrect.
E.g. the prompt requests four sound components, but the audio only has three or vice versa;
the prompt asks for one persor speaking but there are two people in the audio.
2 - Missing/redundant/incorrect more than one components.
1 - Totally incorrect.
Before starting the rating, clear the browser local storage using the following button.
After completing the ratings, click the following button to download the data into a CSV.
There is also a copy of this button at the bottom of the page.
Prompt 0
Rain and thunder
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 1
A loud bang followed by an engine idling loudly
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 2
A man speaking while water runs in the background
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 3
An electric motor runs then a person speaks
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 4
A helicopter engine operating while wind blows heavily into a microphone
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 5
A sewing machine sews followed by a man talking
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 6
A woman talks briefly as several goats bleat including one that has high pitched bleats. A crunch is followed by a man speaking
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 7
High pressure liquid spraying as a radio plays in the background
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 8
Male speech and then scraping
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 9
Mechanical rotation and then a loud click occurs
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 10
A loud bang followed by an engine idling loudly
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 11
Humming from a large engine
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 12
A motor vehicle engine is revving
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 13
A bus engine driving in the distance then nearby followed by compressed air releasing while a woman and a child talk in the distance
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 14
A woman speaks, and a motor vehicle revs its engine
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 15
A vehicle accelerating then driving by as gusts of wind blow and leaves rustle in the distance
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 16
A car engine idling then starts to rev shortly after
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 17
Rain and thunder
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 18
A man talking followed by a camera muffling and footsteps shuffling then wood lightly clanking
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 19
An electric motor runs then a person speaks
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 20
A helicopter engine operating while wind blows heavily into a microphone
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 21
Mechanical rotation and then a loud click occurs
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 22
A machine motor running as a man is speaking followed by rapid buzzing
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 23
A vehicle accelerating then driving by as gusts of wind blow and leaves rustle in the distance
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 24
Train passing followed by short honk
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 25
A woman speaks, and a motor vehicle revs its engine
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 26
Several puppies yapping
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 27
A person gulping followed by glass tapping then liquid shaking in a container proceeded by liquid pouring before plastic thumps on paper
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 28
A nearby insect buzzes with nearby vibrations
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 29
A bus engine driving in the distance then nearby followed by compressed air releasing while a woman and a child talk in the distance
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 30
A bus engine driving in the distance then nearby followed by compressed air releasing while a woman and a child talk in the distance
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 31
High pressure liquid spraying as a radio plays in the background
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 32
A loud bang followed by an engine idling loudly
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 33
Mechanical rotation and then a loud click occurs
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 34
A motor vehicle engine is revving
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 35
A woman speaks, and a motor vehicle revs its engine
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 36
An electric motor runs then a person speaks
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 37
A man speaking while water runs in the background
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 38
Man talking in the wind and someone yells in the background while an engine makes squealing and air puffing sounds
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 39
A person gulping followed by glass tapping then liquid shaking in a container proceeded by liquid pouring before plastic thumps on paper
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 40
Male speech and then scraping
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 41
Mechanical rotation and then a loud click occurs
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 42
Several puppies yapping
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 43
Train passing followed by short honk
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 44
An baby laughing
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 45
Humming from a large engine
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 46
An baby laughing
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 47
A man speaking while water runs in the background
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 48
A man talking followed by a camera muffling and footsteps shuffling then wood lightly clanking
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 49
A horse gallops then trot on grass as gusts of wind blow and thunderclaps in the distance
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 50
A sewing machine sews followed by a man talking
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 51
An baby laughing
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 52
A horse gallops then trot on grass as gusts of wind blow and thunderclaps in the distance
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 53
Train passing followed by short honk
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 54
A man speaking while water runs in the background
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 55
Several puppies yapping
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 56
Several puppies yapping
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 57
A person gulping followed by glass tapping then liquid shaking in a container proceeded by liquid pouring before plastic thumps on paper
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 58
A woman talks briefly as several goats bleat including one that has high pitched bleats. A crunch is followed by a man speaking
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 59
Rain and thunder
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 60
Humming from a large engine
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 61
A car engine idling then starts to rev shortly after
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 62
High pressure liquid spraying as a radio plays in the background
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 63
A woman speaks, and a motor vehicle revs its engine
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 64
A nearby insect buzzes with nearby vibrations
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 65
Train passing followed by short honk
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 66
Rain and thunder
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 67
A bus engine driving in the distance then nearby followed by compressed air releasing while a woman and a child talk in the distance
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 68
Male speech and then scraping
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 69
An electric motor runs then a person speaks
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 70
A machine motor running as a man is speaking followed by rapid buzzing
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 71
A vehicle accelerating then driving by as gusts of wind blow and leaves rustle in the distance
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 72
A machine motor running as a man is speaking followed by rapid buzzing
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 73
A car engine idling then starts to rev shortly after
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 74
A helicopter engine operating while wind blows heavily into a microphone
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 75
A man talking followed by a camera muffling and footsteps shuffling then wood lightly clanking
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 76
A vehicle accelerating then driving by as gusts of wind blow and leaves rustle in the distance
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 77
A motor vehicle engine is revving
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 78
High pressure liquid spraying as a radio plays in the background
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 79
Man talking in the wind and someone yells in the background while an engine makes squealing and air puffing sounds
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 80
A woman talks briefly as several goats bleat including one that has high pitched bleats. A crunch is followed by a man speaking
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 81
A sewing machine sews followed by a man talking
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 82
A machine motor running as a man is speaking followed by rapid buzzing
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 83
A loud bang followed by an engine idling loudly
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 84
Man talking in the wind and someone yells in the background while an engine makes squealing and air puffing sounds
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 85
Male speech and then scraping
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 86
An baby laughing
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 87
A nearby insect buzzes with nearby vibrations
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 88
A horse gallops then trot on grass as gusts of wind blow and thunderclaps in the distance
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 89
Humming from a large engine
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 90
A nearby insect buzzes with nearby vibrations
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 91
A motor vehicle engine is revving
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 92
A car engine idling then starts to rev shortly after
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 93
A helicopter engine operating while wind blows heavily into a microphone
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 94
A horse gallops then trot on grass as gusts of wind blow and thunderclaps in the distance
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 95
A man talking followed by a camera muffling and footsteps shuffling then wood lightly clanking
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 96
A sewing machine sews followed by a man talking
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 97
A person gulping followed by glass tapping then liquid shaking in a container proceeded by liquid pouring before plastic thumps on paper
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 98
Man talking in the wind and someone yells in the background while an engine makes squealing and air puffing sounds
Rate on overall audio quality.
Rate on audio-text correspondence.
Prompt 99
A woman talks briefly as several goats bleat including one that has high pitched bleats. A crunch is followed by a man speaking