Jan
29
2012

Word Sense Disambiguation (Finding the meaning of words) - Reintroduction

For the first post in 2012, it is opportune to look again at WSD. Word-sense disambiguation is the name for the challenge of choosing the correct meaning of a word, its word-sense, in a sentence. To understand the context of a sentence, each of the words must be aligned with the possible meanings in the sentence. See the definition at word-sense disambiguation for a more detailed description of the problem.

We solve the problem by identifying the set of valid senses that apply to a particular sentence. Sentences contain massive amounts of information which apply readily to this problem.

There is another video we will do on this topic that will be released in the next few days. The point is that for computers to understand us, a WSD solution is essential. Like Patom theory, the solution comes from the set of possible answers intersected together to create, yes, linkset intersection.

I look forward to seeing you again soon for the next explanation of this.

Dec
11
2011

Errors in language

If all we needed to do to understand a language was to match the words to phrases and sentences, we would be in good shape.

Unfortunately, languages don't work that way. If U NO WOT I um, er mean 2say 2u. Languages operate on many levels and effective machines need to address this aspect.

By storing, matching and using patterns - list and sets only - we are able to get through these problems.

Dec
10
2011

More ambiguity

Today's video shows the demonstration program breaking down the meanings of more examples.

Until next time we meet, good day to you!

Dec
9
2011

Ambiguity - language's core element

Ambiguity in language is a given. You name it and there will be more than one way to interpret it. As I like to say, if you can't think of 100 ways to say something, you probably aren't trying.

For computer programmers and linguists this has resulted in a need for new ways for machines to understand and a corresponding lack of progress.

This video shows how language ambiguity is handled within the Project Turing demonstration program.

The examples are continued in the more detailed video due out soon.  

Dec
6
2011

Intelligent Dictionary Summary - What it needs to do

An "Intelligent Dictionary" needs to do more than just look for the parts of speech within a sentence. The meaning of a sentence depends upon the use of its words, or so said Ludwig Wittgenstein. What does that even mean?

Let's analyse a sentence or two to help explore this further.

See you next time,

John

Aug
31
2011

What is a word?

Human languages allow us to very concisely and accurately talk about things. Although at some levels talk involves ambiguity (many meanings are possible for the words and phrases used) our ability to discuss complex ideas quickly stems from the fact that talk conveys meaning, not mere words.

Our prototype that resulted from project Turing demonstrates how simple patterns can quickly result in very complex meanings. The hierarchy is the key here – by matching patterns in a hierarchy, higher level patterns rapidly take on meaning which as a single level would be complex.

The video today shows how a word can take on many shapes. Whether it is a list of symbols, like in a number, or of characters as in English words or unbroken strings of characters as in Japanese sentences, meaning comes from the same elements of a sentence. Unfortunately for the programmers of the past trying to match these patterns, the pieces that fit into a sentence are quite varied, as varied as the words that make up a language.

The application of Patom theory does away with a number of issues that plagued programmers in the past. The computer finds the atoms that make up a word, based on its current use, and then seeks to apply it to the current sentence.

To try to make this clearer, a word is something that describes a particular idea. So the number “40” represents the concept of forty things. The phrase “John, Beth and Sue” is a word that describes 3 people. And the phrase “ruthere” which reads “are you there” is a question, a full sentence when you expand it out.

We think that the approach of bundling phrases into words on the fly and ensuring it fits into a sentence is a good way to comprehend real languages - as we want to do.

Aug
28
2011

Word Sense Disambiguation (Finding the meaning of words)

A few years ago after we produced the prototype for language recognition using only stored patterns, a friend of ours suggested that the only thing scientists and engineers care about with regards to language is the accurate meaning of words. He said that is where the action is with Web 3.0 and other semantic technologies.

So like any good developer with a new requirement, we spent a couple of days and added in the additional pattern elements needed to disambiguate word senses from within the words provided in a sentence.

Disambiguation Definition

Disambiguation is the work needed to remove ambiguity - to find the correct meaning of a word from the many choices available and without the effort needed to do it using statistical approaches. This problem was in fact one of the reasons the American's abandoned their work on machine translation back in the 1960s. Much of the hard work needed to disambiguate has been done at Princeton University with their WordNet project. The hard work is compiling a list of word senses which can then be disambiguated.

For example, the word 'blue' in 'the blue woman' may mean she is sad, or she is actually the colour blue. Without the context, we will never know for sure. By applying patom theory, we can link together word senses and use our pattern matching engine to pass through only those meanings that have been experienced before as a starting point, which seems pretty good compared to the alternatives.

The following video shows an example in which sentences with colors and qualifying words like 'hot', 'cool' and 'cold' apply specifically to each other in meaning. Other examples are on the web site such as 'running water' and 'grilled bass' which provide sufficient clarity to remove most of the alternative meanings.

The key to science is understanding in order to find solutions. We feel that this approach will outperform the other approaches and provide the basis for a number of useful applications. 

 

 

About Thinking Solutions

John Ball started Thinking Solutions in the 1990s to build machines based on brain theory. Thinking Solutions is passionate about cognitive science with a strong focus on using patterns to replicate brain capability. 

Month List