<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:content="http://purl.org/rss/1.0/modules/content/"><channel><title>toki pona &middot; Arguable Intelligence</title><link>https://ojmason.net/tags/toki-pona/</link><description>Personal musings on computational linguistics, AI, sailing, and generated fiction.</description><language>en-gb</language><managingEditor>Oliver Mason</managingEditor><webMaster>Oliver Mason</webMaster><lastBuildDate>Mon, 10 Apr 2017 11:27:24 +0100</lastBuildDate><atom:link href="https://ojmason.net/tags/toki-pona/index.xml" rel="self" type="application/rss+xml"/><item><title>Toki Pona</title><link>https://ojmason.net/toki-pona/</link><guid isPermaLink="true">https://ojmason.net/toki-pona/</guid><pubDate>Mon, 10 Apr 2017 11:27:24 +0100</pubDate><category>toki pona</category><category>conlang</category><category>nlp</category><description>Since working in computational linguistics I have been interested in constructed languages (&lsquo;conlangs&rsquo;). When trying to process any natural language with computer programs, you constantly run into inconvenient exceptions, in morphology, syntax, etc. A conlang such as Esperanto promises a great simplification: as it is completely regular, NLP software is likely to be much simpler and less complex. However, given that Esperanto is a full-scale language, it&rsquo;s still not trivial to work with. It&rsquo;s got a large vocabulary, and the syntax is not that easy to parse.</description><content:encoded><![CDATA[<p>Since working in computational linguistics I have been interested in constructed languages (&lsquo;conlangs&rsquo;).
When trying to process any natural language with computer programs, you constantly run into inconvenient
exceptions, in morphology, syntax, etc. A conlang such as <a href="https://en.wikipedia.org/wiki/Esperanto">Esperanto</a>
promises a great simplification: as it is completely regular, NLP software is likely to be much simpler and
less complex. However, given that Esperanto is a full-scale language, it&rsquo;s still not trivial to work with. It&rsquo;s
got a large vocabulary, and the syntax is not that easy to parse.</p>
<p>In a post on the <a href="http://esperanto.stackexchange.com/">Esperanto Language Stack Exchange</a> I then heard of another
conlang, <a href="https://en.wikipedia.org/wiki/Toki_Pona">Toki Pona</a>. This is billed as a <em>minimalist</em> language: it only
has about 120 words, and a very fixed and simplistic sentence structure. Unlike Esperanto, it is not really a
proper language for everyday use, but more of a philosophical experiment. How does your language influence the
way you think about the world? This is kind of related to the <a href="https://en.wikipedia.org/wiki/Linguistic_relativity">Sapir-Whorf Hypothesis</a>.
When you have to limit yourself to describing/paraphrasing everything with a limited vocabulary, you need to
reflect more about what it is you&rsquo;re talking about. For example, a friend is a <em>jan pona</em> (&lsquo;good person&rsquo;), and a
bad person is a <em>jan ike</em>. So how do you say &lsquo;bad friend&rsquo;? You are not able to say someone is both good and bad
at the same time. So a friend cannot be a bad person, or vice versa.</p>
<p>Toki Pona arguably is a toy language only. There is just one word for <em>fruit</em>, <em>vegetable</em>, etc.: <em>kili</em>. If you want
to say <em>banana</em>, you say <em>kili jelo</em> (&ldquo;yellow fruit&rdquo;). If you want to talk about lemons as well, you&rsquo;re out of luck.
It&rsquo;s very context dependent, and definitely not useful for a scientific treatise, or even recipes. But it&rsquo;s fine
for basic stories, myths and legends, and so on. And, most importantly, it&rsquo;s easy to learn. No morphology. Very
limited syntax. Small vocabulary. The main difficulty is to express yourself given those limited means. But
we grow only when challenged!</p>
<p>I&rsquo;m interested in doing NLP with Toki Pona, as it is so limited. It should be possible to quickly get to the semantic
or pragmatic levels, as morphology and syntax will be dealt with easily. Analysing and generating sentences should
be extremely easy. More on that as it materialises.</p>
<p>If you&rsquo;re interested in languages, and what to explore the way you express meaning, give Toki Pona a try. There
are various on-line resources available, plus a text book <a href="http://amzn.to/2oN4Zo7"><em>Toki Pona &ndash; The Language of Good</em></a>.</p>
<p>I&rsquo;ll post more on this at a later time&hellip;</p>
]]></content:encoded></item></channel></rss>