# ropensci/tokenizers

<https://repo.masters-masters.com/en/repos/ropensci/tokenizers>

[Home](https://repo.masters-masters.com/en) › [ropensci](https://repo.masters-masters.com/en/owners/ropensci) › [tokenizers](https://repo.masters-masters.com/en/repos/ropensci/tokenizers)

ropensci/tokenizers has 188 stars on GitHub. Its RepoMasters card: Prototype tier. Fast, Consistent Tokenization of Natural Language Text Language: R.

| Field | Value |
| --- | --- |
| Owner | [ropensci](https://repo.masters-masters.com/en/owners/ropensci) |
| Stars | 188 |
| Forks | 23 |
| Language | [R](https://repo.masters-masters.com/en/languages/r) |
| License | None |
| Created | 2016 |
| Topics | text-mining, tokenizer, rstats, nlp, r, r-package, peer-reviewed |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [ropensci/tokenizers](https://github.com/ropensci/tokenizers) |

## Repository

Fast, Consistent Tokenization of Natural Language Text

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by ropensci

- [ropensci/drake · ★ 1,344 · R · Beta](https://repo.masters-masters.com/en/repos/ropensci/drake)
- [ropensci/skimr · ★ 1,144 · HTML · Beta](https://repo.masters-masters.com/en/repos/ropensci/skimr)
- [ropensci/targets · ★ 1,104 · R · Beta](https://repo.masters-masters.com/en/repos/ropensci/targets)
- [ropensci/tabulapdf · ★ 566 · R · Alpha](https://repo.masters-masters.com/en/repos/ropensci/tabulapdf)
- [ropensci/pdftools · ★ 555 · C++ · Alpha](https://repo.masters-masters.com/en/repos/ropensci/pdftools)
- [ropensci/magick · ★ 484 · R · Alpha](https://repo.masters-masters.com/en/repos/ropensci/magick)

## Nearby in R

- [openpharma/visR · ★ 188 · R · Prototype](https://repo.masters-masters.com/en/repos/openpharma/visR)
- [CSSEGISandData/COVID-19\_Unified-Dataset · ★ 188 · R · Prototype](https://repo.masters-masters.com/en/repos/CSSEGISandData/COVID-19_Unified-Dataset)
- [sachit27/greenR · ★ 188 · R · Prototype](https://repo.masters-masters.com/en/repos/sachit27/greenR)
- [trinker/qdap · ★ 188 · R · Prototype](https://repo.masters-masters.com/en/repos/trinker/qdap)
- [AnalytixWare/ShinySky · ★ 188 · R · Prototype](https://repo.masters-masters.com/en/repos/AnalytixWare/ShinySky)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.