[MPEG-OTSPEC] Defining the text shaping working group’s scope

Thu Jul 30 05:56:07 CEST 2020

Dear Martin and Liang,

Thank you very much for your good listing to figure the outline. Please let me hear your suggestion about "who would publish the output of the Text Shaping WG".

On 2020/07/30 11:38, Martin Hosken wrote:
> 1. Technology Documentation
> Describes the underlying technologies script implementations rely on. For example, OpenType, shaping engines.

Indeed! Detailed information about the existing implementations of OpenType is really really important for the font-related software engineers. I remember, in the past, there was a rumor of a discussion whether the documents of the script-dependent shaping mechanism of OpenType (currently provided by Microsoft) should be a part of ISO specs (or ISO TR), or not, but I cannot remember the conclusion. If the Text Shaping WG is created under the current JTC1/SC29/WG11 font AHG, the WG will make such ISO document? If it is created under Unicode, the WG will make such document as a part of Unicode standard (or UTR)? Either way, I'm sure that it would be an admirable decision.

> 2. Orthographic Information
> This describes the encoding of a particular orthography (or group of orthographies) along with any community expectations regarding styling, behaviour, etc. But it is implementation independent. UTN#11 tries to do this for orthographies using the Myanmar script, as an example.

I must thank for your huge effort for UTN#11. At the same time, I'm afraid that it's really hard task to create such documents as a part of ISO spec (UTN#11 is 67 pages!). Especially for some historic or minority scripts which SIL is working for. Also Liang Hai is working with "Text representation and shaping specification of the Mongolian script" which is assumed to be one of the Unicode Technical Notes. Either I think it's not easy for ISO/IEC 14496-22 to include such documents as the appendix.

Regards,
mpsuzuki

> 3. Design Considerations
> Typographical design considerations across groups of orthographies. May or may not include user experience expectations.
> 
> 4. Engineering Implementation Description
> Describes behavioural implementation details of particular implementations for particular orthographies.
> 
> I suggest that people will tend to gravitate towards one, or maybe two of these categories. And that is fine. This is not a one person game. I also think that funders may also gravitate similarly.
> 
> To me, categories 1 & 2 are foundational and are aiming at normative descriptions. Categories 3 & 4 are also vital to grow the pot of quality font implementations these communities so desperately need.
> 
> The emphasis on orthography here is evident. I hold that the orthography is the primary minimal unit of implementation. Many orthographies have similar needs. But they also have uniquenesses. We need to capture all of that so that implementers can choose the range of orthographies they intentionally or unintentionally will support.
> 
> Yours,
> Martin
> 
>> In terms of defining scope, I would employ a broad view of typographic
>> text display. There are intersections and mutual dependencies to be
>> mapped with text encoding and text interaction (input and editing), but
>> I think a natural scope can be defined in terms of the space where font
>> interaction is necessary to achieve overall layout and display of text,
>> i.e. everywhere from script segmentation to justification.
>>
>> That's the scope I suggested in looking 'beyond shaping' in my IUC39
>> presentation:
>> https://jpn01.safelinks.protection.outlook.com/?url=http%3A%2F%2Ftiro.com%2FJohn%2FHudson_IUC39_Beyond_Shaping.pdf&data=02%7C01%7Cmpsuzuki%40hiroshima-u.ac.jp%7Ce0e4d4f7f7394d6f7f8b08d83431b744%7Cc40454ddb2634926868d8e12640d3750%7C1%7C1%7C637316735420144877&sdata=hc%2FgqoqFl62FtY%2F2T4t2ot7b83NbxDn1IFkDRC%2F8G%2B0%3D&reserved=0
>> To the aspects discussed there, I would add text block orientation, i.e.
>> layout directionality as distinct from character and string directionality.
>>
>> JH
>>
>>> Thank you Liang and Simon for starting the discussion!
>>>
>>> Since we are going to embark on the exploration activity to determine
>>> the scope of this future work, it is extremely important to identify
>>> what relevant information is currently missing [that affects
>>> interoperability of fonts and implementations] and if it needs to be
>>> specified as a formal standard. It is also important to determine who
>>> currently possesses the relevant knowledge and experience, and is
>>> willing to contribute to this important work.
>>>
>>> I also agree with you that it is very valuable to identify all related
>>> documentation, but we also need to be aware of its current status
>>> (public / opensource / proprietary / copyrights, etc.) Knowing what we
>>> have as a starting point (such as e.g. USE document:
>>> https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Ftypography%2Fscript-development%2Fuseand&data=02%7C01%7Cmpsuzuki%40hiroshima-u.ac.jp%7Ce0e4d4f7f7394d6f7f8b08d83431b744%7Cc40454ddb2634926868d8e12640d3750%7C1%7C0%7C637316735420144877&sdata=jOR7MJK4DQWzwnoAjcpwzPZQr2FalldKzuq4e6zyMQQ%3D&reserved=0
>>> all other resources Liang has mentioned) and whether any existing /
>>> prior documentation could be contributed for us to use will not only
>>> give us a head start, but also helps come quickly to a decision on
>>> whether we need to consider publishing formal script-specific text
>>> layout specifications, or if it may be more appropriate to publish it
>>> as OFF/OpenType implementation guidelines, or both.
>>>
>>> All these components – the information about what we have to start
>>> with, who can contribute to this development [and whether they are
>>> willing to do so], and what we believe the outcome of this work should
>>> be – will help us greatly to decide what organization (Unicode
>>> Consortium and this ISO WG were initially named for consideration)
>>> would be best suitable to be selected as the venue for this future work.
>>>
>>> Thank you,
>>>
>>> Vladimir
>>>
>>> *From:*mpeg-otspec <mpeg-otspec-bounces at lists.aau.at> *On Behalf Of
>>> *?? Liang Hai
>>> *Sent:* Wednesday, July 29, 2020 10:35 AM
>>> *To:* mpeg-otspec at lists.aau.at
>>> *Subject:* [MPEG-OTSPEC] Defining the text shaping working group’s scope
>>>
>>> (If this topic confuses you, see the appended background introduction.)
>>>
>>> In order to figure out the scope we care about, how about we start
>>> with maintaining a list of existing projects that are intended to
>>> complement the OT spec (and its semi-standard specs such as the USE spec)?
>>>
>>> In terms of my personal concerns, one of the most important projects
>>> today is this documentation by Nate Willis, et al, which is focused on
>>> documenting how OTL should actually be implemented for each complex
>>> script, so developers can actually implement compatible shapers:
>>>
>>>      *Documentation of OpenType shaping behavior*
>>>
>>>      https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fn8willis%2Fopentype-shaping-documents&data=02%7C01%7Cmpsuzuki%40hiroshima-u.ac.jp%7Ce0e4d4f7f7394d6f7f8b08d83431b744%7Cc40454ddb2634926868d8e12640d3750%7C1%7C1%7C637316735420144877&sdata=cZLqVa3vOzqHB9t5VrKfahdIgyihZWgBkHmnFzMBZIg%3D&reserved=0
>>>      <https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fprotect-us.mimecast.com%2Fs%2FQFjcClYmL2U2KB9mIGIQRV&data=02%7C01%7Cmpsuzuki%40hiroshima-u.ac.jp%7Ce0e4d4f7f7394d6f7f8b08d83431b744%7Cc40454ddb2634926868d8e12640d3750%7C1%7C1%7C637316735420144877&sdata=xYADyGRNmJRMF6ZeeH1b3NmebgHR82XcJ1fR6RT1n04%3D&reserved=0>
>>>
>>> On the other hand, my main personal interest is about clarifying how
>>> Unicode encoded complex scripts (especially the Indic ones) should be
>>> implemented with OTL fonts. (Note the difference from Nate’s project,
>>> which is about how to shape texts using these fonts.)
>>>
>>> I believe we need to document a reference interface between
>>> orthographical correctness and typographical concerns. The whole
>>> process from Unicode text up to this interface can be vetted by
>>> experts (especially for compatibility and reasonable fallback
>>> behavior) and automated by tooling, while font producers are left with
>>> a straightforward glyph set to fill. This will greatly improve
>>> reliability of complex scripts’ fonts, and also remove the
>>> unreasonable obstacle that prevents native users to implement their
>>> own scripts in fonts. Some knowledge collected during this effort
>>> should even be incorporated into the Unicode Standard, if it’s
>>> relevant and the community can achieve an agreement on it.
>>>
>>> The current early draft is still very sketchy, but I expect to
>>> significantly update it and transform it into a tutorial-based
>>> document (because concrete instructions will be much easier to read)
>>> in a couple of months:
>>>
>>>      *Indic text shaping for type designers*
>>>
>>>      https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Ftypotheque%2Ftext-shaping&data=02%7C01%7Cmpsuzuki%40hiroshima-u.ac.jp%7Ce0e4d4f7f7394d6f7f8b08d83431b744%7Cc40454ddb2634926868d8e12640d3750%7C1%7C1%7C637316735420144877&sdata=VRcNmxoyV24jrNyRXqoi4mUfzds%2Fef2Za%2FTOVYefSU4%3D&reserved=0
>>>      <https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fprotect-us.mimecast.com%2Fs%2F_XWACmZn6YIjYm08HOyLHI&data=02%7C01%7Cmpsuzuki%40hiroshima-u.ac.jp%7Ce0e4d4f7f7394d6f7f8b08d83431b744%7Cc40454ddb2634926868d8e12640d3750%7C1%7C1%7C637316735420144877&sdata=tNI8ePr%2BL3sox4Y1B2zTvgS7nwtmvzE4sf7qagPcfmQ%3D&reserved=0>
>>>
>>>
>>> Best,
>>> 梁海Liang Hai
>>> https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flianghai.github.io%2F&data=02%7C01%7Cmpsuzuki%40hiroshima-u.ac.jp%7Ce0e4d4f7f7394d6f7f8b08d83431b744%7Cc40454ddb2634926868d8e12640d3750%7C1%7C1%7C637316735420144877&sdata=WtOQBSneSzIKmOpTnAN6PYHs3EyVL%2B1R3PCg9C%2FxpKU%3D&reserved=0
>>> <https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fprotect-us.mimecast.com%2Fs%2FUOpPCn5oXgs7LJygUNFAcv&data=02%7C01%7Cmpsuzuki%40hiroshima-u.ac.jp%7Ce0e4d4f7f7394d6f7f8b08d83431b744%7Cc40454ddb2634926868d8e12640d3750%7C1%7C1%7C637316735420144877&sdata=nrOX1QZyb%2BLXk1zRdn4omBcbzkPWdjKBVtlh9AawMKU%3D&reserved=0>
>>>
>>> ---
>>>
>>> Some context for subscribers of this mailing list who didn’t
>>> participate in yesterday’s meeting:
>>>
>>> There’s a collective effort to seek a clear path forward for improving
>>> the whole text shaping industry (including the font formats)’s
>>> situation. Yesterday there was the first meeting, and the next meeting
>>> (open to all) is scheduled for four weeks later (25 Aug, 13:30–14:50
>>> UTC-4). The following document contains yesterday’s meeting notes:
>>>
>>>      Text Shaping Working Group (working title)
>>>
>>>      https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.google.com%2Fdocument%2Fd%2F1KoknOb0IMAPeiLhifvc_AqB7s3rs6VKOsTQg_oCDypQ%2Fedit%3Fusp%3Dsharing&data=02%7C01%7Cmpsuzuki%40hiroshima-u.ac.jp%7Ce0e4d4f7f7394d6f7f8b08d83431b744%7Cc40454ddb2634926868d8e12640d3750%7C1%7C1%7C637316735420144877&sdata=YBirn8hPrkKt6e4IMsKOPgsd6Y2ao51PBX2whWaBO%2FY%3D&reserved=0
>>>      <https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fprotect-us.mimecast.com%2Fs%2F813pCo20KjhrG7o5c6dpOk&data=02%7C01%7Cmpsuzuki%40hiroshima-u.ac.jp%7Ce0e4d4f7f7394d6f7f8b08d83431b744%7Cc40454ddb2634926868d8e12640d3750%7C1%7C1%7C637316735420154831&sdata=eUSXg7tLWW%2BEns3S5AiEb%2Fzm3qwjgSYOdPN84a7kcRk%3D&reserved=0>
>>>
>>> By the end of the meeting we decided this list could be a temporary
>>> home for our discussions because of the significant overlap of
>>> interest. I hope we’re /not/ spamming you guys.
>>>
>>>
>>> _______________________________________________
>>> mpeg-otspec mailing list
>>> mpeg-otspec at lists.aau.at
>>> https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.aau.at%2Fmailman%2Flistinfo%2Fmpeg-otspec&data=02%7C01%7Cmpsuzuki%40hiroshima-u.ac.jp%7Ce0e4d4f7f7394d6f7f8b08d83431b744%7Cc40454ddb2634926868d8e12640d3750%7C1%7C0%7C637316735420154831&sdata=XfztFE2rDD3gZo%2FOnN8HyB5HWlUlw4W7kME1iVRU4u8%3D&reserved=0
>>
>>
>> -- 
>>
>> John Hudson
>> Tiro Typeworks Ltd    https://jpn01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.tiro.com%2F&data=02%7C01%7Cmpsuzuki%40hiroshima-u.ac.jp%7Ce0e4d4f7f7394d6f7f8b08d83431b744%7Cc40454ddb2634926868d8e12640d3750%7C1%7C1%7C637316735420154831&sdata=xG5D0iaFWUqZOHNNZ8QMb8jSemVnmjwezBzJFsMzJ2A%3D&reserved=0
>> Salish Sea, BC        tiro at tiro.com
>>
>> NOTE: In the interests of productivity, I am currently
>> dealing with email on only two days per week, usually
>> Monday and Thursday unless this schedule is disrupted
>> by travel. If you need to contact me urgently, please
>> use some other method of communication. Thank you.
>>
> _______________________________________________
> mpeg-otspec mailing list
> mpeg-otspec at lists.aau.at
> https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.aau.at%2Fmailman%2Flistinfo%2Fmpeg-otspec&data=02%7C01%7Cmpsuzuki%40hiroshima-u.ac.jp%7Ce0e4d4f7f7394d6f7f8b08d83431b744%7Cc40454ddb2634926868d8e12640d3750%7C1%7C0%7C637316735420154831&sdata=XfztFE2rDD3gZo%2FOnN8HyB5HWlUlw4W7kME1iVRU4u8%3D&reserved=0
> 