Index of DH Conferences

Current filter is returning 1 out of 8823 works

The Trials of Tokenization

Full text is public

Work type: paper, specified "long paper"

David L. Hoover

Keywords: programming punctuation python tokenization word frequency lists

Topics: english natural language processing programming software design and development standards and interoperability text analysis

Languages: English

Presented at ADHO - 2015 - Sydney - Western Sydney University

Filter

Ordering

Text

Search abstracts by title and by full text content when available. Search will look for all terms by default. Use OR to look for any terms in the query, and quotation marks to search for exact phrases.

Conference

The conference where this abstract was submitted/published.

Full text has been indexed

Full text is publicly viewable

Work type

Abstracts may belong to one type that has been defined by editors based on a survey of all the abstracts in this collection, e.g. "poster", "workshop", "long paper".

Author

Abstract authorship must include this person

Institution

Works having at least one author belonging to ANY of the selected institutions.

Affiliation

Works having at least one author belonging to a specific department or other center within a larger institution.

Keywords

Optional keywords that are supplied by authors during submission. (Matches ANY of the keywords)

Languages

The language(s) of the text of an abstract (not to be confused with e.g. 'English' as a keyword, where the topic of the abstract concerns English.) (Matches ANY of the languages)

Topics

Optional topics from a conference-specific controlled vocabulary. (Matches ANY of the topics)

Reset

Works search results

The Trials of Tokenization