• Dataset Description
  • Dataset Summary
  • Supported Tasks and Leaderboards
  • Languages
• Dataset Structure
  • Data Instances
  • Data Fields
  • Data Splits
• Dataset Creation
  • Curation Rationale
  • Source Data
  • Annotations
  • Personal and Sensitive Information
• Considerations for Using the Data
  • Social Impact of Dataset
  • Discussion of Biases
  • Other Known Limitations
• Additional Information
  • Dataset Curators
  • Licensing Information
  • Citation Information
  • Contributions

• Homepage: https://catalog.ldc.upenn.edu/LDC99T42

• Repository: 'https://raw.githubusercontent.com/wojzaremba/lstm/master/data/ptb.train.txt', 'https://raw.githubusercontent.com/wojzaremba/lstm/master/data/ptb.valid.txt', 'https://raw.githubusercontent.com/wojzaremba/lstm/master/data/ptb.test.txt'

• Paper: https://www.aclweb.org/anthology/J93-2004.pdf

• Leaderboard: [Needs More Information]

• Point of Contact: [Needs More Information]

This is the Penn Treebank Project: Release 2 CDROM, featuring a million words of 1989 Wall Street Journal material. The rare words in this version are already replaced with token. The numbers are replaced with token.

Language Modelling

The text in the dataset is in American English

[Needs More Information]

[Needs More Information]

[Needs More Information]

[Needs More Information]

[Needs More Information]

[Needs More Information]

[Needs More Information]

[Needs More Information]

[Needs More Information]

[Needs More Information]

[Needs More Information]

[Needs More Information]

[Needs More Information]

Dataset provided for research purposes only. Please check dataset license for additional information.

@article{marcus-etal-1993-building, title = "Building a Large Annotated Corpus of {E}nglish: The {P}enn {T}reebank", author = "Marcus, Mitchell P. and Santorini, Beatrice and Marcinkiewicz, Mary Ann", journal = "Computational Linguistics", volume = "19", number = "2", year = "1993", url = "https://www.aclweb.org/anthology/J93-2004", pages = "313--330", }

Thanks to @harshalmittal4 for adding this dataset.