how to create a function that counts all words in a document?

30 views (last 30 days)
I am attempting to make a function that takes in a speech as an input argument in a text file. I would then like to read the speech and have matlab count and return the number of occurrences for every word in the speech. Any ideas?

Answers (3)

John D'Errico
John D'Errico on 25 Mar 2015
Edited: John D'Errico on 25 Mar 2015
Easy, peasy.
1. Using lower, make all words lower case, so you need not worry about capitalization.
2. Apply my allwords code to the string. Use spaces and any appropriate punctuation as separator characters.
3. Use unique to get the distinct words in that list. The third argument from unique will be important.
4. Apply accumarray to that third argument from unique to count the words.
Essentially 4 quick lines of code.
John D'Errico
John D'Errico on 26 Mar 2015
textread is the simple answer. Or use fopen, then fread, or fgets or fgetl.
No need to convert anything to a string if it is a string already as read in.

Sign in to comment.

Sarah Palfreyman
Sarah Palfreyman on 30 Apr 2018
Get the size of the string returned by extractFileText in Text Analytics Toolbox

Christopher Creutzig
Christopher Creutzig on 26 Nov 2018
Check out the bagOfWords class in Text Analytics Toolbox. It solves exactly this problem.
(You may want to have some preprocessing to match exactly what you consider to be the same word. E.g., lowercasing, so “House” and “house” are the same. Unless you want Dr. House not to be counted as a house, of course …)

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!