Data sources and licences

lexinspect analyses text against published word lists, dictionaries and formulas compiled by other researchers. Those resources are their work, not ours. Several are shared under licences that require attribution to you, the person receiving the analysis, not merely to whoever reads the source code. This page is that attribution. If you publish anything derived from lexinspect output, cite the original authors below, not lexinspect.

Academic Word List — awl

Coxhead, A. (2000). A new academic word list. TESOL Quarterly, 34(2), 213–238.
570 word families across 10 sublists. Freely usable for educational and research purposes.

BNC/COCA word-family lists — bnc/coca

Nation, I. S. P. (2017). The BNC/COCA Level 6 word family lists (Version 1.0.0). Victoria University of Wellington.
25 bands of 1,000 word families with all their members, plus the supplementary lists of proper names, marginal words, transparent compounds and acronyms. Source: Paul Nation's vocabulary lists. Licence: CC BY-SA 4.0 — attribution and share-alike required. lexinspect's reformatted copy (bnc_coca.json) is shared under the same licence.

New General Service List and New Academic Word List — ngsl

Browne, C., Culligan, B., & Phillips, J. (2013). The New General Service List 1.2 and The New Academic Word List 1.2.
NGSL in its “lemmatized for teaching” version, with inflected and UK/US forms. Source: newgeneralservicelist.com. Licence: CC BY-SA 4.0 — attribution and share-alike required. lexinspect's reformatted copies are shared under the same licence.

CEFR vocabulary profiles — cefr

CEFR-J Vocabulary Profile 1.5 (A1–B2). Compiled by Yukio Tono, Tokyo University of Foreign Studies. Copyright Tono Laboratory, TUFS. Free for research and commercial use with citation; this page is that citation.
Octanove Vocabulary Profile C1/C2 1.0. Octanove Labs. Licence: CC BY-SA 4.0.
Both via openlanguageprofiles/olp-en-cefrj. lexinspect's merged file is shared under CC BY-SA 4.0 with both credits.

Not the Cambridge English Vocabulary Profile. Different corpora and methodology; results will diverge from EVP-based tools.

Phrasal Expressions List — phrase

Martinez, R., & Schmitt, N. (2012). A phrasal expressions list. Applied Linguistics, 33(3), 299–320.
Via Norbert Schmitt's resources page, which states the materials are freely available for research and pedagogical purposes. lexinspect is offered free of charge for exactly those purposes.

Metadiscourse markers — metadiscourse

Hyland, K. (2005). Metadiscourse: Exploring Interaction in Writing. Continuum, London and New York.
The ten-category taxonomy is Hyland's intellectual contribution. Cite Hyland (2005) in any output. The hedges list mirrors Hyland's Appendix A via HLTCHKUST/framing-bias-metric.

British and American spelling variants — lookups

VarCon (Variant Conversion Info), part of SCOWL. Copyright 2000–2016 Kevin Atkinson; copyright 2016 Benjamin Titze.
Permission to use, copy, modify, distribute and sell this array, the associated software, and its documentation for any purpose is granted without fee, provided that the copyright notice appears in all copies and that both it and this permission notice appear in supporting documentation. Provided “as is” without express or implied warranty. Via wordlist.aspell.net.

Pronouncing dictionary — readability

The Carnegie Mellon Pronouncing Dictionary, version 0.7a. Copyright (C) 1993–2008 Carnegie Mellon University. BSD-style licence; redistributed with its copyright notice and conditions.

Dale–Chall familiar words — readability

The Dale–Chall easy-word list (Chall, J. S., & Dale, E. (1995). Readability Revisited: The New Dale–Chall Readability Formula. Brookline Books), as distributed with textstat. textstat: MIT licence, Copyright (c) 2016 Shivam Bansal.

Hunspell dictionaries — errors

LibreOffice English dictionaries, via LibreOffice/dictionaries, pinned to a fixed commit.
en_GB: wordlist based on Kevin Atkinson's English wordlist, updated by David Bartlett, Brian Kelk, Andrew Brown and Marco A. G. Pinto; affix file by David Bartlett and Andrew Brown. Both LGPL.
en_US: wordlist from SCOWL by Kevin Atkinson and others (permissive SCOWL copyright); affix file derived from Geoff Kuenning's Ispell (BSD).

Software

lexinspect itself is MIT licensed. It stands on spaCy and its en_core_web_sm model, spylls, and FastAPI.

The authoritative, versioned copy of this list, with provenance notes for each dataset, is data/SOURCES.md.