The tokenization has been tuned to work well with text conventions commonly used in social media such as Twitter, and supports URLs, hashtags, emails and @-mentions cleanly.

Required Ruby Version

>= 0

Authors

johnnytomcat

Versions

  1. 0.0.2

    1. source

      1. 0.0.2 source February 24, 2016 (8.5 KB)
  2. 0.0.1

    1. source

      1. 0.0.1 source December 29, 2015 (8.5 KB)

SHA 256 checksum

← Previous version