About Us Icon About Us Icon Business Analyst Icon Business Analyst Icon CEO Icon CEO Icon Datameer Icon Datameer Icon Envelope Icon Envelope Icon Facebook Icon Facebook Icon Google Plus Icon Google Plus Icon Instagram Icon Instagram Icon IT Professional Icon IT Professional Icon Learn Icon Learn Icon Linkedin Icon Linkedin Icon Product Icon Product Icon Partners Icon Partners Icon Search Icon Search Icon Social Networks Icon Social Networks Icon Share Icon Share Icon Support Icon Support Icon Testimonial Icon Testimonial Icon Twitter Icon Twitter Icon

Datameer Blog

How-to: Tokenize Text in Datameer

By on January 23, 2014

**In this weekly blog series, engineering and support staff at Datameer share their favorite features in Datameer.** 

If you have a string of text in a single cell and want to break that text into individual words that each display in their own row, you want to become familiar with the Tokenize function in Datameer. This is helpful to do things like sentiment analysis or to find out what words are used more commonly than others in support tickets, for example.

Before Tokenize:

Non-tokenized text

Applying the Tokenize Function is as simple as selecting the Tokenize function and highlighting the column you want to tokenize:

Formula Builder


Tokenize Results

You can try this yourself with our free trial; just download the “Twitter Brand Sentiment Analysis” application from our app market to get some sample data to work with if you don’t have your own, then follow along with this quick video demo:

Connect with Datameer

Follow us on Twitter
Connect with us on LinkedIn, Google+ and Facebook

Eduardo Rosas