Showing posts with label Noosphere. Show all posts
Showing posts with label Noosphere. Show all posts

14 June 2010

🔖Knowledge Representation: DIKW (Part I: An Introduction)

Collocations like “Web of data”, “Web of Information” “Web of Knowledge” “Data Management”, “Information Management”, “Knowledge Management”, “Data Technologies”, “Information Technologies”, “Knowledge Technologies” and other similar such compounds involving Data, Information and Knowledge (DIK) are increasingly and interchangeably used in various contexts by vendors, customers, researchers and bloggers, sometimes being misused from confusion or exaggeration. On the other side it is true that the border between data, information and knowledge can be shallow, and from here rise up divergent opinions and theories, and as always people like to fight about their ideas and believes. To the three adds wisdom forming what is known as DIKW, the Knowledge Pyramid, however wisdom is less met in the technical landscape presumptively because it’s harder to express and quantify.

DIKW reveals the layered evolution of information from data to knowledge and further to wisdom; it’s just a wide accepted model, a pyramidal representation to which there were attempts of including proto-facts and facts [2], understanding [1] [6], transaction and intuition [7], vision and “One Mindness” [6], and probably other similar attempts might be there in the deep web. Sometimes such theories are pure philosophy apparently without applicability and quite far away from the work of scientists who are used to juggle with data, information and knowledge, relatively easy to quantify and grasp compared to wisdom, intuition, meaning, creativity, vision, consciousness, awareness or any other similar terms that made, since ancient times, philosophers’ delight. 

On the other side the scientific work is built upon the philosophic work, and seemingly as new advancements are made the “New Age” philosophies tend to be integrated in scientific work. From the concepts from the second group, only meaning has started to stir up researcher’s attention, and this mainly in AI domain, which attempts to bridge the gap between humans and machines. I suppose there are attempts also in the area of creativity, vision, intuition or wisdom, though it will be difficult to do concludent steps until the barriers of meaning are not broken.

Data is considered to be “simple isolated facts” [4], a combination of "symbols or isolated and non-interpreted facts" [5], symbols, raw that “simply exists and has no significance beyond its existence” [10], quantified or qualified symbol sets, signals or sensory stimuli perceived [3], etc. Be it facts, symbols, events, signals or sensory stimuli, it is highlighted their isolated and not-interpretable characteristics. When we think of data we refer mainly to the written symbols, independent on whether they have or not meaning for us – a digit or set of digits, a letter and the words they form, an image or any combination of them. In a apparently collection of signs, each sign could be regarded as a data chunk, though it happens that we decipher patterns of signs that we know, for example words, phone numbers, addresses, coordinates, time, etc. In database terminology data refers to a matrix structure (columns vs. records) in which each cells of the matrix contains a data chunk that nowadays could be any aggregation of signs and data types a database system supports. 

 As we can see interpretations of data could have different granularity dependent on the form of aggregation and purpose, thus a natural question: when could we discuss about information? For sure a collection of data is not information, then what ingredient(s) is/are essential in having a chunk of information? I believe that there are two magic words – relation and meaning, actually meaningful relation. Using various algorithms, and even from a simple review of the data, researchers could establish various relations between two data chunks, for example that they always occur together, that one causes the other, that XYZ is the address of John Smith, and so on. 

To make it even more complicated, for an IT professional, a structure, and I’m referring here mainly to databases, supposes already the existence of relations between data, thus statements like XYZ is the address of John Smith who was born on 1st of July and works for ABC are already available. Of course, only few relations are useful, just because two chunks of data occur together, in one or several locations, this doesn’t mean that such a relation is meaningful, while in other situations that might be quite important. 

When we discuss about a meaningful relation we actually imply a context, a multidimensional (mental) frame in which meaning is formed and derived from. Thus a relation could be meaningful in one context and irrelevant in another, and that’s why many say that data don’t equate with information. Discovering that the evolution from data to information is context dependent could maybe solve some of the philosophical disagreements, though this aspect makes it difficult to find a common accepted definition for information. Basically information is just chunks of data found in (meaningful) relation(s).

 In what concerns knowledge things are not less complex, the just formulated definition for information could be adapted from my point of view also to knowledge, advancing the idea that knowledge is information found in meaningful relation. Establishing meaningful relations between information implies a certain level of understanding, conscious or unconscious processing and systematization of information, their integration in the existing mental structures - contexts. Mental structures apply here not only to individuals but also to communities, in the past years the later gaining considerable importance. 

Communities equate with networks, and networked is also the structure of the knowledge, this involving a dynamic (evolutional) nature, with multiple values of truth, levels of organization and granularity. The systematization and integration of knowledge relies on existing or new formed patterns based on characteristics of knowledge. There were written many books about knowledge, trying to depict its characteristics, and there are so many facets that it’s difficult to find a definition that accommodates all the types of knowledge – tacit vs. explicit knowledge, personal vs. networked knowledge, declarative vs. procedural, practical vs. theoretical knowledge, personal vs. collective knowledge, contextual, situational or definitional knowledge, and so on. I find it quite important to understand the various types of characteristics because each of them comes with their own characteristics and uses.

Wisdom is skillful use of knowledge, knowledge put into use, transcended knowledge, understanding the patterns and principles of knowledge, knowing when, where, how, why and by what means to apply the knowledge. Wisdom involves also keeping the balance between the various aspects of situations, strengths and weaknesses altogether, minimizing or totally overcoming biases. In spiritual literature and tradition, wisdom plays a fundamental role, the many books on this topic attempting to reveal the qualities (dimensions) and implications of wisdom. I will limit myself only to give two quotes, namely one from A. Einstein who was remarking that "wisdom is not a product of schooling of the lifelong attempt to acquire it", and B. Russel was remarking that “although our age far surpasses all previous ages in knowledge, there has been no correlative increase in wisdom” [8].

The new added scales to the DIKW pyramid are questionable, it’s kind of a gray area, based maybe on deeper considerations not so easy to grasp, while the lack of definitions and argumentation makes the understanding process even more difficult.  The best example regarding the lack of definitions is the proto-fact, in such situations we could eventually call into help the possible etymological formation. The prefix proto-, from Greek protos, when used in compounds has the meaning of “first” or “before”, thus that proto-facts could be considered as basic/primary facts, maybe axioms, idea that matches also [5]’s view, who’s considering them as assumptions that are used to extract new facts from the world. Following this definition or assumption, proto-facts and facts are rather information, data describing them at most so I really don’t see why the facts and proto-facts are considered as the lower layer on which data layer is based, this because I see data as describing facts, mainly as quantitative or qualitative associations.

From a creationist point of view, everything is vibration, what we perceive is nothing but grossier vibrations taking various forms, some of them recepted and processed by our senses. The layer that comes into contact with the medium (environment) is called by [7] the transaction layer, where the “packets” of sensations are put onto or taken off of the medium, and before any data can exist, the packets have to be received, unpacked and assembled into data. Even if the denomination of transaction layer is not maybe the best, and the description is quite simplistic, this should be at high level the process in which the stimuli from the outside and inside world are transformed by our senses and brain in the so called “data”, forming our continuous reality. [7] believes that somewhere at this level the intuition occurs, though it could be also at higher level as long everything happens within the unconscious mind. Without going to deep into philosophical debate I would limit myself to say that I find well-founded the adding of intuition into DIKW scale, and I could put it on the same level with creativity, innovation, and vision, all three dimensions transcend knowledge and have their important role in understanding and further in wisdom’s attainment. The role of intuition and creative is reinforced also within Edward de Bono’s Six Thinking Hats, red hat representing the intuition, while the green hat, the creativity.

 Vision and “one mindness” seem to come from the New Age vocabulary though they are not so far away from modern science, vision in technical terms is reflected in forecasting, approximating the future based on past trends, while “one mindness” is the principle or the state of art behind Noosphere. It’s true, in what concerns the human being and the actual stage of development, such terms sound to be inapplicable, on the other side when we consider that everything is in continuous evolution/involution, everything is possible. From the point of view of machines (computers), given their interconnectedness and processing power everything is possible.

When we look from a relational point of view, data are symbols with no explicit relation between them, information are data with an explicit relation, knowledge is relational patterns of information, wisdom is patterns of knowledge, intuition is the comprehension of patterns without sensing the patterns consciously, creativity is the discovery or transmutation of new patterns, and maybe it worth to mention also innovation, seen by [9] as the rearranging of relations. More difficult to define from the perspective of relations are the “one mindness” and symbols. The “one mindness” could be eventually regarded as a reflection of the interconnectedness and comprehensions of all existing patterns, including the divine patterns in case of humans. Symbols are at their turn a pattern but of a lower refinement, at form-energetic level. The complexity or relations or patterns denotes the overall complexity, though our senses already hide a higher level of complexity, and most probably here are the barriers of our spiritual and scientific worlds.

In what concerns the meaning, symbols can have or not meaning, or different meanings in different contexts, same could be said about data, information and eventually knowledge, but I would expect that at wisdom and upper levels meaning is fundamental, even conscious or unconscious. With the evolution from data to wisdom and further, the meaning and the relations become richer and more complex. And we can’t discuss about meaning without discussing about context. I tend to believe data have an extrinsic context given by the medium in which they occur, though that’s not necessarily relevant. As per my above given definition, information supposes the existence of a meaningful relation and thus the placement in one or more contexts, while with the integration within a context we could talk already about knowledge.  Probably wisdom acts like a bridge point between contexts, visions extrapolates contexts while in “one mindness” everything becomes one context.

Most of the resources I’ve seen focus mainly on the evolution from data to wisdom, though there is also a feedback mechanism, for example the more high quality data we collect the more are the chances to validate current theories or discover more generalized theories, enriching thus our luggage of information, possibly further evolved to upper layers. It’s interesting also to study the interaction between the various layers, for that having to take into account also the existing theories of learning, of dynamic systems, etc. 

Note:
    I left out understanding from this post because is a complex (philosophical) concept even if everybody has an idea what is about. Please note that I haven’t tried to review the existing DIKW models, but just to write down my thoughts, to create a basis for further posts.

References:
[1] Wikipedia. (2009). DIKW. [Online] Available from: http://en.wikipedia.org/wiki/DIKW (Accessed: 7 May 2009)
[2]  Visual Concept. (1998). Making Meaning. [Online] Available from: http://www.visual-concept.co.uk/makingmeaning.htm (Accessed: 10 February 2009)
[3] Zins, C. (2007). Journal of American Society for Information Science and Technology, 58(4): 279-293, 2007. Wiley InterScience. [Online] Available from: http://www.success.co.il/is/zins_definitions_dik.pdf (Accessed: 16 May 2009)
[4] (Ken) McLennan, K. J.. "Chapter 20 - Knowledge". The Virtual World of Work: How to Gain Competitive
[5] M. J. Coombs ,  H. D. Pfeiffer ,  R. T. Hartley (). e-MGR: an architecture for symbolic plasticity. Int. J. Man-Machine Studies http://www.cs.nmsu.edu/~hdp/PDF/plastic.pdf
[6] OneMind. (2009). Seven Levels of Interaction [Online] Available from: http://onemind.com/2009/12/19/ (Accessed: 7 June 2010)
[7] G. Czerepak. (2007) TIDIKW. [Online] Available from: http://relationary.wordpress.com/2007/07/14/dikw (Accessed: 8 June 2010)
[8] B. Russel. Knowledge and Wisdom
[9] [Online] Available from:  http://thingamy.typepad.com/sigs_blog/2010/01/information-knowledge-wisdom-and-innovation.html (Accessed: 14 June 2010)
[10] G. Bellinger, D. Castro, A. Mills (2004) Data, Information, Knowledge, and Wisdom. [Online] Available from: http://www.systems-thinking.org/dikw/dikw.htm (Accessed: 14 June 2010)

20 April 2009

🕸️Web x.0: Web's evolution - Part 1

The Web 2.0 term was proposed by Tim O’Reilly in conference brainstorming session between O'Reilly and MediaLive International, in which he envisioned several competencies. With the new versioning the old fashioned Web, as we know it, became Web 1.0, while in the literature were mentioned other two versions - Web 3.0 for the Semantic Web and Web 4.0 for the Noosphere. There are many people who are not comfortable with the version addressing of the Web, on one side it doesn’t seem natural, while on the other side it’s the easiest manner to encompass the set of characteristics or philosophies in the smallest unit of meaning.

The transition between the different versions is occasionally marked with vague comparisons in which are reflected two or three characteristics, some of them are fixed, while other dependent on authors’ expectations. Into the below table I tried to put together some of the characteristics of what each Web version is about, there are still blank spaces, there are even wild guesses about what the future might bring. The table is not perfect, but it summarizes somehow my understanding about Web’s expectations.
 

Dimension Web 1.0 Web 2.0 Web 3.0 (Semantic Web) Web 4.0 (Noosphere)
User participation read only read-write collaborate human-machine collaboration
Intelligence Individual Intelligence Collective Intelligence Swarm Intelligence Artificial Intelligence*
Content creation companies communities ecologies human-machine ecologies
Content focus owning sharing aggregating reasoning
Indexing directories/taxonomies folksonomies Knowledge Maps Large Language Models*
User expression home pages blogs/webcasts social networks ?
DIKW focus data information knowledge wisdom
Macro-focus document centric content centric knowledge centric wisdom centric
Content accessibility Web forms Web Services meshups semantic applications
Content presentation web sites portals meshup aggregations ?
Content structuring HTML XML XML programming-based aggregation XML concept-based aggregation
Vector-based graphics applets RIA RIA 2 semantic RIA
Ads advertising pay-per-click ? ?
Information access searching subscription (to services) contextual filtering prompt engineering*
Knowledge structure taxonomies ontologies networks Lego-like networks
Data mining emphasis Web logs behavior concept-based pragmatic
(*) Updared Dec-2025

Probably one major drawback of the above table is that it had no timeline associated with each stage, though it got right the importance of AI in term of collaboration, forming of ecologies, the importance of semantics, reasoning and "wisdom". 

18 April 2009

🕸️Web x.0: The Semantic Web (Part I: An Introduction)

Even if I’m just a newbie in Semantic Web and Semantic Technologies, in the past months I had the chance to give some thought to this idea. The way I see it, the Semantic Web targets to make content processable and understandable by machines, and not necessarily targets, at this stage, to evolve the Web to a space of “machine reasoning”, in which machines can replace human reasoning with comparable results. This state of art won’t be achieved also in the next foreseen stage, named Noosphere by a few Web theoreticians, for example [1]. 

The Noosphere, formed from nous (mind) and sphere (space or circle), can be regarded as a “space of human thought” supposed to reflect in real time the dynamics of collective intelligence, the role of visualization (reflection) and aggregation tools being essential. In time, I suppose that machines will grow (in) intelligence, being more and more capable to handle various tasks more like humans. When this will happen?! Who knows… Along the time the world’s theoretical models barriers were pushed beyond previous existing limits, so everything is possible, even braking the barriers of Goedel’s incompleteness theorems.

The Semantic Web is just a stage in the evolution of the Web, same as Web’s versions, it reflects a new way of thinking about Web, its role, expectations and tools supposed to fulfill them. Each person or community can have its own expectations and way of approaching the Semantic Web, lot of effort being spent in different directions, reinventing the wheel, technologies that die soon after they were born. Most of the researchers consider ontologies as the backbone on which the Semantic Web has to be built, many technologies focusing on this perspective. There are also scientists who question the achievability of a Semantic Web or the role of ontologies in this picture. C. Shirky’s [2], supported also by P. Gaendenfors [3], sustains that “the Semantic Web is a machine for creating syllogisms” and therefore it will improve only the areas that uses syllogistic reasoning. 

Conversely, ontologies are just islands of knowledge not anchored in reality, they offer only a view/map of the world, and even if they reflect the commitment to common agreement, they are not a commitment to completeness. Ontologies are supposed to be created mainly by experts, involve high costs, considerable effort and coordination, and it seems that they follow the fallacies of OOP programming, breaking apart in their own complexity and require redesign when new facts are brought into the picture or the scope changes. As new knowledge is acquired or the requirements changes, the work on ontologies never ends, ontologies matching and integration involving other type of issues. Even more, to make things even fuzzier, M.K. Gergman [4] mentions more than 40 information structures that have been labeled in one way or another as ontology – tag cloud, controlled vocabulary, topic map, concept map, etc. Another important aspect neglected by ontologies seems to be the fuzzy nature of truth, while other issues derive from the information representational structure problems: symbol grounding problem, frame problem [5] and contextual emergence [6].

The goal of the Semantic Web is to “get people to use more meta-data” [2], and why not to create metadata, of harnessing the Collective Intelligence, as [7] formulates it. It has started with wikis and folksonomies, and might continue with more complex annotations, for example Knowledge Maps. It is created thus a layer of connectivity on top of physical structure of the Web Graph.

From my point of view Web theoreticians focus on high level goals and ignore the immediate needs of the users, which are often excluded from the Semantic Web equation. Models and technologies that target only the scientific world (e.g. ontologies) have low chances to make a difference in the Web space. The Web users need (free) tools that can be used for metadata creation, collaboration, information processing, knowledge mapping and diffusion. At least in the near future machines won’t achieve the thinking performances of humans about the world, though maybe once the Web riches the state of a Semantic Web, things would be much simpler.

References:
[1] Levy, P. (2005). From Cyberspace to Noosphere. [Online] Available from: http://www.minervaeurope.org/events/parma/papers/levy_ppt.ppt (Accessed: 26 January 2009)
[2] Shirky, C. (2003). The Semantic Web, Syllogism, and Worldview. [Online] Available from: http://www.shirky.com/writings/semantic_syllogism.html (Accessed: 7 February 2009)
[3] Gaerdenfors, P. (2004 B). Conceptual Spaces as a Framework for Knowledge Representation. [Online] Available from: http://www.mindmatter.de/mmpdf/gaerdenfors.pdf (Accessed: 9 January 2008)
[4] M.K. Gergman. 2009. ‘Structs’: Naïve Data Formats and the ABox.[Online] Available from: http://www.mkbergman.com/?p=471(Accessed: 17 April 2008)
[5] Duch, W. (1995) From cognitive models to neurofuzzy systems - the mind space approach. [Online] Available from: http://www.fizyka.umk.pl/publications/kmk/95sams.pdf (Accessed: 13 January 2009)
[6] Atmanspacher, H., Foundation, P., beim Graben, P. (2005). Contextual Emergence of Mental States from Neurodynamics. [Online] Available from: http://www.igpp.de/english/tda/pdf/potsdama12.pdf (Accessed: 13 January 2009)
[7] O’Reilly, T. (2005). What Is Web 2.0: Design Patterns and Business Models for the Next Generation of Software. [Online] Available from: http://www.oreillynet.com/pub/a/oreilly/tim/news/2005/09/30/what-is-web-20 (Accessed: 18 April 2009)
Related Posts Plugin for WordPress, Blogger...