wikillm

Paper · 2017-10-28 · cs.CL

JSUT corpus: free large-scale Japanese speech corpus for end-to-end speech synthesis

Design of the JSUT corpus: about 10 hours of reading-style Japanese speech from one female speaker, recorded at 48 kHz with transcripts. Sentences cover the main readings of daily-use kanji, plus subsets for loanwords, paraphrases, onomatopoeia, travel and court text, and repeated readings. No model is trained and no benchmark is reported; only corpus statistics are given.

Dataset curationspeech-corpusdatasetspeech-synthesisjapanese

arXivPDFMarkdown7 min read

AI-compiled by claude-haiku-5-5 on 2026-11-12, not yet reviewed by a human. Every claim cites its source; check it when a detail matters.

In plain words

Teaching a computer to read text aloud needs many recordings of a person speaking, with the matching text. For Japanese, no free collection of that size existed. This paper describes one: about ten hours of a single woman reading sentences aloud, with the text of each sentence, published online for others to use.

The authors did not only collect random sentences. They picked them so that the common Japanese characters appear with all of their usual pronunciations, and they added sentences with loanwords, counting words, paraphrases, sound words, travel and court text, and some sentences read several times. The goal is to train systems that turn text straight into speech without an intermediate phonetic step.

The paper is about the dataset, not a new model. It explains how the corpus was designed and recorded, and gives some statistics on sentence length and on how the speaker's pitch changed across recording days.

TL;DR

A dataset paper from 2017. It describes JSUT: 10 hours of reading-style Japanese speech from one non-professional female speaker, recorded at 48 kHz with UTF-8 transcripts, split into nine sub-corpora §2.1. The sentence selection targets pronunciation coverage of daily-use kanji rather than phonemes §2.1. The paper reports corpus statistics only: no speech model is trained and no benchmark result is given. Read the Pitfalls before using the audio or the licence terms.

Problem

Japanese speech synthesis lacked a free, large speech corpus that academic and commercial users can share. The authors argue that such a corpus would help end-to-end speech synthesis, which maps text to speech without linguistic intermediate representations §1. The authors say Japanese is harder for this than English, Spanish or German, because it needs extra steps such as working out meaning from text and converting spelling to sounds §1. Existing corpora were judged unsuitable for this purpose §1.

The corpus is deliberately not built around phonemes or prosody labels. Its main purpose is to cover all main pronunciations of daily-use Japanese characters, including individual readings, because these are not measured by phoneme or prosody representations §1 §2.1.

Method

The paper is a corpus-design paper. It contains no algorithm alg., no equations and no tables. The design has three parts: the sub-corpora §2.1, how each sentence set was assembled §2.2, and how the speech was recorded and annotated §3.1. The sketch below restates that build order in code form; the paper itself has no algorithm box.

Pseudocode
# JSUT corpus assembly, as described in the paper  [§2] [§3.1]
# Input:  candidate sentences per sub-corpus, one speaker
# Output: text + 48 kHz speech + recording day per utterance

def build_corpus(sub_corpora, speaker):
    # Sentence sets: basic5000, countersuffix26, loanword128, ...  [§2.1]
    utterances = []
    for name, sentences in sub_corpora.items():
        # Repeat sets read several times, e.g. 5 times  [§2.2.7]
        readings = repeat_count(name)
        for sentence in sentences:
            for _ in range(readings):
                # Recorded in an anechoic room over several days  [§3.1]
                audio = record(speaker, sentence)
                # Scale power only; no other edit stated  [§3.1]
                audio = normalise_power(audio)
                utterances.append((sentence, audio, recording_day))
    return utterances
  1. Sub-corpora. The corpus has nine sub-corpora. The number in each name is the number of utterances §2.1. The table below restates them with the sources the paper gives.
Sub-corpusUtterancesContent and how it was builtSection
basic50005000Sentences from Wikipedia and the TANAKA corpus, plus hand-written sentences for readings they did not cover. Aims at all main readings of the 2136 daily-use kanji.§2.2.1
countersuffix2626Crowdsourced sentences with counter suffixes, where the reading of a numeral changes.§2.2.2
loanword128128Crowdsourced sentences with loanwords, plus Wikipedia sentences with pronunciations outside the modern Japanese system.§2.2.3
utparaphrase512512256 sentences, each paired with a version where one word or phrase is replaced by a paraphrase from the SNOW E4 corpus.§2.2.4
voiceactress100100Sentences from the Voice Actress Corpus with the pause positions changed by hand.§2.2.5
onomatopee300300Crowdsourced sentences with Japanese onomatopoeia.§2.2.6
repeat500500The same 100 Voice Actress sentences, each read 5 times, to measure natural variation between readings.§2.2.7
travel10001000Travel-domain sentences from an English-Japanese translation alignment corpus.§2.2.8
precedent130130 (text says 138)Copyright-free court precedent sentences, manually shortened or edited to be easier to read.§2.2.8
  1. Sentence sourcing. Crowdsourced sentences were collected with Lancers §3.1. Sentences from public text sources were used where the paper names them §2.2.1 §2.2.3 §2.2.8.

  2. Recording. One female native Japanese speaker, not a professional, read the sentences in an anechoic room. Recordings were made on several days in February, March, September and October 2017 §3.1. The speaker recorded herself with the authors' recording system §3.1.

  3. Post-processing. Power was normalised. Otherwise no changes were made to the audio §3.1. Commas marking breath groups were added by hand §3.1.

  4. Release. The distributed files are UTF-8 sentences, 48 kHz speech and recording information. The recording information gives the day of each utterance, so the day effect can be handled §3.1.

Hyperparameters

Corpus and recording parameters. "not stated" marks values the paper does not give.

NameValueWhereNotes
speakers1, female, native Japanese, not a professional speaker§3.1
recording roomanechoic room§3.1
recording datesFeb, Mar, Sep, Oct 2017, a few hours per day§3.1
sampling rate48 kHz§3.1
sample format16-bit per sample, RIFF WAV§3.1
transcript encodingUTF-8§3.1
total duration10 hours§3.1 §1includes small non-speech regions
loudnesspower normalised§3.1no other modification stated
breath-group commasadded by hand§3.1positions manually annotated
repeated readings5 readings of each of 100 sentences§2.2.7
F0 extractorWORLD analysis-synthesis§3.2used for the per-day analysis
word and mora countingMeCab with NEologd dictionary§3.2
microphone and noise floornot stated
segmentation of recordings into filesnot stated
file naming schemenot stated
phoneme or prosody labelsnone provided§2.1the design avoids them

Results

Author-reported corpus statistics. The paper trains no model, so there are no speech quality or accuracy results. Setup: one speaker; statistics computed on part of the corpus, the size of which is not stated §3.2.

MeasureMinMeanMaxSource
moras per utterance737.14133fig. 1 caption
words per utterance218.0370fig. 2 caption
  • The text gives the longest utterances as 70 words and 140 moras §3.2. See Pitfalls for the mismatch with the figure caption.
  • Mean log-F0 was plotted for each recording day fig. 3. The paper reports no numbers from it. It says the first half of the recording days show no clear trend and the second half show a rise §3.2.

Paper vs code

No official code. The paper releases a dataset and no training or model code. The authors' lab publishes a label repository, sarulab-speech/jsut-label. It holds context labels, pronounced texts and kana forms for the corpus, with no scripts, and it has a LICENCE.txt that the README describes as CC BY-SA 4.0 for the label data. It is data, not code, so it is not recorded as code. A third-party loader, tarepan/jsut (MIT), also exists. It was not used. Both were found by a GitHub repository search for "jsut corpus" and a WebFetch of the project page linked in §1.

Pitfalls

  • Precedent count. The sub-corpus name says 130 utterances §2.1, but the text says 138 precedent sentences §2.2.8. The names add up to 7,696 utterances with 130, or 7,704 with 138. Check the released files before relying on either number.
  • Maximum mora count. The text says the longest utterances have 140 moras §3.2. The caption of fig. 1 gives a maximum of 133. The word maximum of 70 agrees in both places.
  • Analysis subset. The paper says it skipped part of the data to cut computation time §3.2, and gives no subset size. The statistics above are not corpus totals.
  • One speaker. All speech is from one non-professional speaker §3.1. The paper does not evaluate how well a model generalises across speakers.
  • Recording drift. Log-F0 changed over the recording days fig. 3. The paper says drift of this kind is known from long recording periods §3.2. Use the per-day information in the release to split or balance data, or to check for drift in a model.
  • No phoneme or prosody labels. The corpus has text and audio only §2.1. Any phonetic input has to come from a separate front end. The paper names WORLD for F0 §3.2 but gives no alignment or phoneme set.
  • Sampling rate. The audio is 48 kHz §3.1. The paper does not describe resampling for models that use a lower rate. The choice is left to the implementer.
  • Licence conflict to resolve. The arXiv licence of this paper is CC BY-SA 4.0 (see frontmatter). That licence covers the paper text, not the speech files. The conclusion frames permitted use as academic work and non-commercial work, and says the latter also covers work inside companies §4. A WebFetch of the project page linked in §1 reported, as a paraphrase, that the text data is CC BY-SA 4.0, that audio may be used for academic, non-commercial and personal purposes, that redistribution is not permitted except for a small excerpt, and that commercial use is welcome on contact with the authors. Those audio terms are narrower than CC BY-SA. Treat the audio as not cleared for commercial use until a person checks the project page and the authors' terms. This card does not reproduce any audio.
  • Sentence sources. Some sentences come from Wikipedia, court text, a translation alignment corpus and a voice-actress corpus §2.2. Their own licences are not checked in this card.

Lineage

  • Builds on: the WORLD analysis-synthesis system for F0 §3.2; the SNOW E4 paraphrase corpus §2.2.4; the Voice Actress Corpus §2.2.5; the moment matching speech synthesis method of Takamichi et al., which motivates the repeated readings §2.2.7. None of these has a card in this wiki.
  • Compared against: none. The paper compares no corpora or models.
  • Superseded by: not stated in this card's sources.

Source and license

Adapted from “JSUT corpus: free large-scale Japanese speech corpus for end-to-end speech synthesis” by Ryosuke Sonobe, Shinnosuke Takamichi, Hiroshi Saruwatari (arXiv:1711.00354), used under CC BY-SA 4.0. Changes: condensed and restructured for implementation, with tables, equations and algorithms taken from the paper and its code, each cited to its source. Not affiliated with or endorsed by the authors. This page is licensed under CC BY-SA 4.0.