2,354
edits
Changes
Jump to navigation
Jump to search
Line 2:
Line 2: + + Line 7:
Line 9: + + + + + + + +
Text SOM descriptions
== Kohonen SOM Visualisations ==
== Kohonen SOM Visualisations ==
These Self Organising Maps (SOMs) acts as 2D spacial summariser visualisations of (multidimensional) text distance metrics generated from the weekly content on its.an.education.project. Using a geographic like landscape metaphor for visualisation, height (colour gradient) indicates features with strong associations; proximity represents association between features (i.e related words), and label size is a rough guide to basic frequency of the feature. There are many "correct" map layouts for the same set of data, each generation will usually settle into a slightly different set of local minima, but the associations are no less valid for each. After removing linguistic junk words, and word stemming, the map is currently picking the top ~200 features by frequency. The map is continuous and wraps around north/south and east/west (surface of a torus).
[[Image:SOM_legend.jpg|172px]]
[[Image:SOM_legend.jpg|172px]]
[[Image:2008-May-10-16-som.jpg|200px]]
[[Image:2008-May-10-16-som.jpg|200px]]
[[Image:2008-May-17-23-som.jpg|200px]]
[[Image:2008-May-17-23-som.jpg|200px]]
== What Do They Show ==
Well, you could just treat them like tag clouds, showing the top 200 word features used on the list for a given week, but the maps also hold spacial information. Word features that appear close together on the map were used closely (on average) in text content from the list. A height metaphor is also used to indicate the features with the strongest mean associations. The map auto centres on the hot pink peak features, these have the strongest association with all the rest of the features on the map; word features in the blue and green areas have weaker associations, but should not be considered negatively.
== Future ==
I'll continue to refine the mapping algorithms and visualisation style, and will post details here on any significant modifications. The code base was originally designed for bulk text documents from a single author, tested on works of literature from Project Gutenberg.