87
edits
Changes
Jump to navigation
Jump to search
Human Interface Guidelines/The Sugar Interface/Input Systems (view source)
Revision as of 13:32, 29 November 2006
, 13:32, 29 November 2006no edit summary
<div style="background-color: #FFF; margin-left:auto; margin-right: auto; width: 95%;">
{{hig-subnav|prev_link=Security|prev=Security|next_link=The Sugar Interface/Layout Guidelines|next=Layout Guidelines}}
===Input Systems===
====Keyboard====
[[Image: keyboard_layout.jpg|thumb|600px|center|The basic laptop keyboard layout.]]
=====Localized Keyboard Layouts=====
* [[:Image:Keyboard_arabic.jpg|Arabic]]
* [[:Image:Keyboard_argentina.jpg|Spanish (Argentinian)]]
* [[:Image:Keyboard_brazil.jpg|Portuguese (Brazilian)]]
* [[:Image:Keyboard_nigeria.jpg|Nigerian]]
* [[:Image:Keyboard_thai.jpg|Thai]]
* [[:Image:Keyboard_layout.jpg|US International]]
=====Description of Keys=====
{|border=1 cellpadding=3 cellspacing=3 style="margin: 1em auto 1em auto; border: 1px #666666 solid; border-collapse: collapse; background: #f9f9f9;"
!style="background:#cccccc;"|Key!!style="background:#cccccc;"|Function
|-style="background: #e9e9e9;"
|colspan="2"|'''View Keys'''
|-
|[[Image:Key_zoom.jpg|right]]
|Transitions among [[#Neighborhood|Neighborhood]], [[#Friends|Friends]], [[#Home|Home]], and [[#Activities|Activity]] views.
|-
|[[Image:Key_bboard.jpg|right]]
|Toggles visibility of the [[#Bulletin_Boards|Bulletin Board]] for the current view
|-
|[[Image:Key_frame.jpg|right]]
|Toggles visibility of the [[#The_Frame|Frame]]
|-style="background: #e9e9e9;"
|colspan="2"|'''Hardware Controls'''
|-
|[[Image:Key_camera_mic.jpg|right]]
|Toggles the built-in [[#Camera|camera]] and [[#Microphone_and_Speakers|microphone]] (with Fn key) on and off
|-
|[[Image:Key_volume.jpg|right]]
|This slider key functions as an analog volume control.
|-
|-style="background: #e9e9e9;"
|colspan="2"|'''Special Functions'''
|-
|[[Image:Key_viewsource.jpg|right]]
|The [[#View_Source|View Source]] key (gear) peels away the activity layer, allowing children to view the underlying source code. It is accessed in combination with the Fn key.
|-
|[[Image:Key_grab.jpg|right]]
|Grab key for panning/scrolling...
|-
|[[Image:Key_slider.jpg|right]]
|The middle of the three large [[#Softkey_Sliders|"slider"]] keys at the top center of the keyboard is available for use by activities. The slider can be mapped directly to a control in software.
|-style="background: #e9e9e9;"
|colspan="2"|'''Editing Keys'''
|-
|[[Image:Key_enter.jpg|right]]
|We've enlarged the enter key, and given it a visual indicator that maps directly to the graphics used in the UI. All instances of the confirm and cancel icons within the interface will be selectable directly via the enter and escape keys - a relationship strengthened by this visual mapping.
|-
|[[Image:Key_esc.jpg|right]]
|The escape key has a visual indicator that maps directly to the screen graphics, complementing the enter key.
|-
|[[Image:Key_erase.jpg|right]]
|We've replaced the backspace and delete keys with an erase key. This new term more accurately describes its functionality both for erasing a few characters of text, but also for erasing drawings, sounds, and other objects. (Fn-Erase deletes beneath the cursor.)
|-
|[[Image:Key_tab.jpg|right]]
|The Tab key differs little from those on modern keyboards. Shift-Tab functions as a reverse tab, as visually indicated on the key.
|-style="background: #e9e9e9;"
|colspan="2"|'''Modifier Keys'''
|-
|[[Image:Key_ctrl.jpg|right]]
|The control key is the primary modifier for keyboard shortcuts on the laptops. Note that the control key takes the place of the nominally useful caps lock key on the OLPC keyboards. The removal of caps lock was a design decision on the part of the OLPC team, however placement of the control key in its location followed naturally, since this was its original placement prior to the advent of modern PCs, and is still widely accepted among many communities.
|-
|[[Image:Key_shift.jpg|right]]
|The shift key is used as a modifier for typing capital letters and other "upper" characters.
|-
|[[Image:Key_alt.jpg|right]]
|The alt key is a multipurpose modifier.
|-
|[[Image:Altgr.jpg|right]]
|The alternate graphics key is used to select the alternate characters printed on the right half of the key caps. The language key (found on the Thai and Arabic keyboards) acts as an Alt Gr Lock, switching the entire keyboard to the alternate characters. In this "locked" state, the Alt Gr key is used to select the Latin characters on the left half of the key caps.
|-
|[[Image:Key_arabic.jpg|right]][[Image:Key_thai.jpg|right]]
|The Arabic and Thai language keys act as an Alt Gr Locks, switching the entire keyboard to the alternate characters. In this "locked" state, the Alt Gr key is used to select the Latin characters on the left half of the key caps.
|-
|[[Image:Key_fn.jpg|right]]
|Fn is the function key. It is used to further modify keys; e.g., it is used to access the microphone; it modifys the arrow keys to home, end, page up, and page down; it is used to enable the analog slider controls; and it is used to convert the number key row from 1–dash to F1–F11.
|-style="background: #e9e9e9;"
|colspan="2"|'''Navigation Keys'''
|-
|[[Image:Key_arrows.jpg|right]]
|The standard arrow keys up, down, left, and right also operate as page up, page down, home and end respectively when used in conjunction with the Fn key.
|}
=====Softkey Sliders=====
The slider keys have two modes: "digital" and "analog." In digital mode, the discrete functions printed on the key caps are accessed, four per key. In analog mode, accessed with the Fn key, intermediate key codes are enabled—there are seven positions along the slider; intermediary postions are interpolated in software, turning each of the keys into a 13-position slider.
=====Keyboard Shortcuts=====
For the purposes of development, you may want to review the detailed specifications for keys and their codes on the [[OLPC_Keyboard_layouts|Keyboard Layout]] page.
This section should also go into more detail on the global keyboard shortcut tool which allows children to adjust their preferred key bindings, both at the OS level and for individual activities. Again, this is an interface that activities should implement, so there should be an API link.
====Trackpad====
[[Image: Trackpad.png|thumb|320px|left|The dual purpose trackpad supports finger and stylus stimuli.]]
The laptops employ a new development in trackpad technology; it is dual mode: capacitive (finger controlled); and resistive (used with a stylus as in a graphics tablet). With the addition of the stylus mode, children may write and draw directly within an activity, adding a personal touch to chat conversations or a signed email to a friend.
Only the center region of the trackpad has capacitance, responding to a finger. The entire trackpad responds to a stylus.
=====Trackpad as Mouse=====
The use of the finger on the central trackpad area serves as the primary input device for pointing. Though external USB mice will work seamlessly with the laptops, their availability will be limited, and activity designers should not expect that children will have access to them. This means that a certain lack of precision can be expected when moving the cursor about the screen, and activities should not require extremely precise motion. Excessively small controls should also be avoided for similar reasons; details on how to design interface elements reside in the [[#Controls|Controls]] section.
Mouse motion...
In addition, the laptops have two buttons positioned beneath the trackpad for input. The left button is the primary button with which elements of the interface are selected, pressed, or activated. The right button has secondary functionality. Typically, the right mouse button invokes contextual menus, the content of which pertains directly to the interface element the mouse is positioned over.
=====Trackpad as Graphics Tablet=====
When used with a stylus (none are included with the laptop; any small blunt utensil—such as a stick—will work), the entire sensing area accepts stimuli. The graphics tablet, which matches the width of the screen, uses absolute positioning.
Details...
====Microphone and Speakers====
The laptop has a built-in microphone and stereo speakers to allow for voice communication and recording. You may integrate audio functionality directly into your activities by requesting access to this hardware in the Functional Manifest. There are also an external microphone and speaker jacks.
Need a section on using sounds in activities; particularly in the background...
====Camera====
The laptops have built-in cameras to allow for still photography and video recording. You may integrate camera functionality directly into your activities by requesting access to this hardware in the Functional Manifest.
==="Hand-held" Mode===
The laptops feature a hand-held mode of operation in which the screen swivels around 180 degrees and folds flat, similar to a tablet PC. In this mode, the screen covers the keyboard and trackpad; however, the microphone and camera, mounted within the display bezel, remain available for use. Additionally, bezel-mounted controls provide auxiliary input suitable for the activities that Hand-held mode is designed to support: reading an eBook, playing games, etc.
====Energy Saving Benefits====
The laptop is engineered for extreme operating efficiency—a goal furthered by Hand-held mode. The CPU can be suspended while still displaying on-screen graphics. While reading an eBbook, since the screen need only be updated when a page is changed, the time spent reading any given page requires no use of the CPU. The screen can run in reflective (daylight) mode—with the backlight off—for additional energy savings. These factors combine to create an extremely low-power, energy-efficient machine; Hand-held mode provides a usage scenario where maximal energy savings can be attained.
====Implementing Hand-held Controls====
Unlike a typical tablet PC, the OLPC laptop does not have a touch-sensitive screen. Primary user input comes from two bevel-mounted button sets: the D-pad (directional pad), which has 8 directions of articulation; and the button controller, which houses 4 discrete buttons (labeled ◯, ╳, △, ▢, on the B1 machine).
=====The Directional Buttons=====
The D-pad should ''not'' be, in general, used to move a cursor around the screen— in fact, the cursor will hide by default in Hand-held mode. Instead, it should be used for more discrete operations, such as flipping through pages, scrolling a view, or jumping to focusable elements on screen. When an interface necessitates focusable elements, these should be visually apparent and arranged in a natural order. In most cases, "natural order" will mean scan-line order, or the way in which one reads a page of text, but this may adapt to suit the needs of the activity. For instance, some activities may opt to scan first by column, then by row; some may use a clockwise ordering some may even zig-zag across the screen. All of these arrangements are acceptable as long as their orderings logically follow from one to the next according to the visuals provided on screen.
Specific activities may in fact benefit from a more traditional cursor. Some games, for instance, may require one. To support these cases, the cursor may be explicitly shown. However, these instances should be carefully considered, since in many cases a cursor will provide a simple yet inefficient solution to a problem for which a better one exists.
=====The Controller Buttons=====
Generally speaking, the controller buttons can act either as standard event triggers, or as modifier buttons to the target of the D-pad controls. A common use for standard buttons is as select and cancel buttons. In such instances, the ◯ button should always represent confirmation, selection, or forward progress, while the ╳ button represents cancel, escape, or backward progress. Adhering to these guidelines will make navigation of Hand-held interfaces consistent.
When used as a modifier, the visuals on screen should clearly indicate which of the directions—up, down, left, right—perform actions, and those actions likewise should be clearly indicated. For instance, in the eBook, holding down ∆ displays an overlay listing the book's chapters, and the up/down arrows will have focus within this list while the modifier key remains pressed. The currently selected chapter appears in the center of the screen, and up and down arrows above and below the selected chapter clearly indicate how to scroll through the list. When activities implement a combination of both standard and modifier buttons, we encourage ╳ and ◯ for standard, and △ and ▢ for modifiers, since the former two are easier to hit with natural finger placement.
====Built-in Hardware in Hand-held Mode====
Both the camera and microphone reside within the display bezel, and as such remain available for activities to use within Hand-held mode. The important trade off to consider before using the camera or microphone is that of energy efficiency: while the laptop conserves energy in Hand-held mode, continued use of either of these two devices requires constant CPU usage, virtually eliminating the benefits. Therefore, do not simply integrate these hardware components unless they provide a fundamental service to your activity—but don't let this deter you from doing so where appropriate.
{{hig-subnav|prev_link=Security|prev=Security|next_link=The Sugar Interface/Layout Guidelines|next=Layout Guidelines}}
{{hig-subnav|prev_link=Security|prev=Security|next_link=The Sugar Interface/Layout Guidelines|next=Layout Guidelines}}
===Input Systems===
====Keyboard====
[[Image: keyboard_layout.jpg|thumb|600px|center|The basic laptop keyboard layout.]]
=====Localized Keyboard Layouts=====
* [[:Image:Keyboard_arabic.jpg|Arabic]]
* [[:Image:Keyboard_argentina.jpg|Spanish (Argentinian)]]
* [[:Image:Keyboard_brazil.jpg|Portuguese (Brazilian)]]
* [[:Image:Keyboard_nigeria.jpg|Nigerian]]
* [[:Image:Keyboard_thai.jpg|Thai]]
* [[:Image:Keyboard_layout.jpg|US International]]
=====Description of Keys=====
{|border=1 cellpadding=3 cellspacing=3 style="margin: 1em auto 1em auto; border: 1px #666666 solid; border-collapse: collapse; background: #f9f9f9;"
!style="background:#cccccc;"|Key!!style="background:#cccccc;"|Function
|-style="background: #e9e9e9;"
|colspan="2"|'''View Keys'''
|-
|[[Image:Key_zoom.jpg|right]]
|Transitions among [[#Neighborhood|Neighborhood]], [[#Friends|Friends]], [[#Home|Home]], and [[#Activities|Activity]] views.
|-
|[[Image:Key_bboard.jpg|right]]
|Toggles visibility of the [[#Bulletin_Boards|Bulletin Board]] for the current view
|-
|[[Image:Key_frame.jpg|right]]
|Toggles visibility of the [[#The_Frame|Frame]]
|-style="background: #e9e9e9;"
|colspan="2"|'''Hardware Controls'''
|-
|[[Image:Key_camera_mic.jpg|right]]
|Toggles the built-in [[#Camera|camera]] and [[#Microphone_and_Speakers|microphone]] (with Fn key) on and off
|-
|[[Image:Key_volume.jpg|right]]
|This slider key functions as an analog volume control.
|-
|-style="background: #e9e9e9;"
|colspan="2"|'''Special Functions'''
|-
|[[Image:Key_viewsource.jpg|right]]
|The [[#View_Source|View Source]] key (gear) peels away the activity layer, allowing children to view the underlying source code. It is accessed in combination with the Fn key.
|-
|[[Image:Key_grab.jpg|right]]
|Grab key for panning/scrolling...
|-
|[[Image:Key_slider.jpg|right]]
|The middle of the three large [[#Softkey_Sliders|"slider"]] keys at the top center of the keyboard is available for use by activities. The slider can be mapped directly to a control in software.
|-style="background: #e9e9e9;"
|colspan="2"|'''Editing Keys'''
|-
|[[Image:Key_enter.jpg|right]]
|We've enlarged the enter key, and given it a visual indicator that maps directly to the graphics used in the UI. All instances of the confirm and cancel icons within the interface will be selectable directly via the enter and escape keys - a relationship strengthened by this visual mapping.
|-
|[[Image:Key_esc.jpg|right]]
|The escape key has a visual indicator that maps directly to the screen graphics, complementing the enter key.
|-
|[[Image:Key_erase.jpg|right]]
|We've replaced the backspace and delete keys with an erase key. This new term more accurately describes its functionality both for erasing a few characters of text, but also for erasing drawings, sounds, and other objects. (Fn-Erase deletes beneath the cursor.)
|-
|[[Image:Key_tab.jpg|right]]
|The Tab key differs little from those on modern keyboards. Shift-Tab functions as a reverse tab, as visually indicated on the key.
|-style="background: #e9e9e9;"
|colspan="2"|'''Modifier Keys'''
|-
|[[Image:Key_ctrl.jpg|right]]
|The control key is the primary modifier for keyboard shortcuts on the laptops. Note that the control key takes the place of the nominally useful caps lock key on the OLPC keyboards. The removal of caps lock was a design decision on the part of the OLPC team, however placement of the control key in its location followed naturally, since this was its original placement prior to the advent of modern PCs, and is still widely accepted among many communities.
|-
|[[Image:Key_shift.jpg|right]]
|The shift key is used as a modifier for typing capital letters and other "upper" characters.
|-
|[[Image:Key_alt.jpg|right]]
|The alt key is a multipurpose modifier.
|-
|[[Image:Altgr.jpg|right]]
|The alternate graphics key is used to select the alternate characters printed on the right half of the key caps. The language key (found on the Thai and Arabic keyboards) acts as an Alt Gr Lock, switching the entire keyboard to the alternate characters. In this "locked" state, the Alt Gr key is used to select the Latin characters on the left half of the key caps.
|-
|[[Image:Key_arabic.jpg|right]][[Image:Key_thai.jpg|right]]
|The Arabic and Thai language keys act as an Alt Gr Locks, switching the entire keyboard to the alternate characters. In this "locked" state, the Alt Gr key is used to select the Latin characters on the left half of the key caps.
|-
|[[Image:Key_fn.jpg|right]]
|Fn is the function key. It is used to further modify keys; e.g., it is used to access the microphone; it modifys the arrow keys to home, end, page up, and page down; it is used to enable the analog slider controls; and it is used to convert the number key row from 1–dash to F1–F11.
|-style="background: #e9e9e9;"
|colspan="2"|'''Navigation Keys'''
|-
|[[Image:Key_arrows.jpg|right]]
|The standard arrow keys up, down, left, and right also operate as page up, page down, home and end respectively when used in conjunction with the Fn key.
|}
=====Softkey Sliders=====
The slider keys have two modes: "digital" and "analog." In digital mode, the discrete functions printed on the key caps are accessed, four per key. In analog mode, accessed with the Fn key, intermediate key codes are enabled—there are seven positions along the slider; intermediary postions are interpolated in software, turning each of the keys into a 13-position slider.
=====Keyboard Shortcuts=====
For the purposes of development, you may want to review the detailed specifications for keys and their codes on the [[OLPC_Keyboard_layouts|Keyboard Layout]] page.
This section should also go into more detail on the global keyboard shortcut tool which allows children to adjust their preferred key bindings, both at the OS level and for individual activities. Again, this is an interface that activities should implement, so there should be an API link.
====Trackpad====
[[Image: Trackpad.png|thumb|320px|left|The dual purpose trackpad supports finger and stylus stimuli.]]
The laptops employ a new development in trackpad technology; it is dual mode: capacitive (finger controlled); and resistive (used with a stylus as in a graphics tablet). With the addition of the stylus mode, children may write and draw directly within an activity, adding a personal touch to chat conversations or a signed email to a friend.
Only the center region of the trackpad has capacitance, responding to a finger. The entire trackpad responds to a stylus.
=====Trackpad as Mouse=====
The use of the finger on the central trackpad area serves as the primary input device for pointing. Though external USB mice will work seamlessly with the laptops, their availability will be limited, and activity designers should not expect that children will have access to them. This means that a certain lack of precision can be expected when moving the cursor about the screen, and activities should not require extremely precise motion. Excessively small controls should also be avoided for similar reasons; details on how to design interface elements reside in the [[#Controls|Controls]] section.
Mouse motion...
In addition, the laptops have two buttons positioned beneath the trackpad for input. The left button is the primary button with which elements of the interface are selected, pressed, or activated. The right button has secondary functionality. Typically, the right mouse button invokes contextual menus, the content of which pertains directly to the interface element the mouse is positioned over.
=====Trackpad as Graphics Tablet=====
When used with a stylus (none are included with the laptop; any small blunt utensil—such as a stick—will work), the entire sensing area accepts stimuli. The graphics tablet, which matches the width of the screen, uses absolute positioning.
Details...
====Microphone and Speakers====
The laptop has a built-in microphone and stereo speakers to allow for voice communication and recording. You may integrate audio functionality directly into your activities by requesting access to this hardware in the Functional Manifest. There are also an external microphone and speaker jacks.
Need a section on using sounds in activities; particularly in the background...
====Camera====
The laptops have built-in cameras to allow for still photography and video recording. You may integrate camera functionality directly into your activities by requesting access to this hardware in the Functional Manifest.
==="Hand-held" Mode===
The laptops feature a hand-held mode of operation in which the screen swivels around 180 degrees and folds flat, similar to a tablet PC. In this mode, the screen covers the keyboard and trackpad; however, the microphone and camera, mounted within the display bezel, remain available for use. Additionally, bezel-mounted controls provide auxiliary input suitable for the activities that Hand-held mode is designed to support: reading an eBook, playing games, etc.
====Energy Saving Benefits====
The laptop is engineered for extreme operating efficiency—a goal furthered by Hand-held mode. The CPU can be suspended while still displaying on-screen graphics. While reading an eBbook, since the screen need only be updated when a page is changed, the time spent reading any given page requires no use of the CPU. The screen can run in reflective (daylight) mode—with the backlight off—for additional energy savings. These factors combine to create an extremely low-power, energy-efficient machine; Hand-held mode provides a usage scenario where maximal energy savings can be attained.
====Implementing Hand-held Controls====
Unlike a typical tablet PC, the OLPC laptop does not have a touch-sensitive screen. Primary user input comes from two bevel-mounted button sets: the D-pad (directional pad), which has 8 directions of articulation; and the button controller, which houses 4 discrete buttons (labeled ◯, ╳, △, ▢, on the B1 machine).
=====The Directional Buttons=====
The D-pad should ''not'' be, in general, used to move a cursor around the screen— in fact, the cursor will hide by default in Hand-held mode. Instead, it should be used for more discrete operations, such as flipping through pages, scrolling a view, or jumping to focusable elements on screen. When an interface necessitates focusable elements, these should be visually apparent and arranged in a natural order. In most cases, "natural order" will mean scan-line order, or the way in which one reads a page of text, but this may adapt to suit the needs of the activity. For instance, some activities may opt to scan first by column, then by row; some may use a clockwise ordering some may even zig-zag across the screen. All of these arrangements are acceptable as long as their orderings logically follow from one to the next according to the visuals provided on screen.
Specific activities may in fact benefit from a more traditional cursor. Some games, for instance, may require one. To support these cases, the cursor may be explicitly shown. However, these instances should be carefully considered, since in many cases a cursor will provide a simple yet inefficient solution to a problem for which a better one exists.
=====The Controller Buttons=====
Generally speaking, the controller buttons can act either as standard event triggers, or as modifier buttons to the target of the D-pad controls. A common use for standard buttons is as select and cancel buttons. In such instances, the ◯ button should always represent confirmation, selection, or forward progress, while the ╳ button represents cancel, escape, or backward progress. Adhering to these guidelines will make navigation of Hand-held interfaces consistent.
When used as a modifier, the visuals on screen should clearly indicate which of the directions—up, down, left, right—perform actions, and those actions likewise should be clearly indicated. For instance, in the eBook, holding down ∆ displays an overlay listing the book's chapters, and the up/down arrows will have focus within this list while the modifier key remains pressed. The currently selected chapter appears in the center of the screen, and up and down arrows above and below the selected chapter clearly indicate how to scroll through the list. When activities implement a combination of both standard and modifier buttons, we encourage ╳ and ◯ for standard, and △ and ▢ for modifiers, since the former two are easier to hit with natural finger placement.
====Built-in Hardware in Hand-held Mode====
Both the camera and microphone reside within the display bezel, and as such remain available for activities to use within Hand-held mode. The important trade off to consider before using the camera or microphone is that of energy efficiency: while the laptop conserves energy in Hand-held mode, continued use of either of these two devices requires constant CPU usage, virtually eliminating the benefits. Therefore, do not simply integrate these hardware components unless they provide a fundamental service to your activity—but don't let this deter you from doing so where appropriate.
{{hig-subnav|prev_link=Security|prev=Security|next_link=The Sugar Interface/Layout Guidelines|next=Layout Guidelines}}