Najjar, L. J. (2003). User interface device for improved accessibility (Georgia Tech Research Corporation invention disclosure 2660). Unpublished manuscript.
Lawrence J. Najjar
Georgia Tech Research Institute
Centennial Research Building
Human Systems Engineering Branch
400 Tenth Street, NW
Atlanta, GA 30332
The User Interface Device for Improved Accessibility makes it very easy for persons with a wide variety of disabilities to operate machines such as photocopiers, facsimile machines, postage meters, automated teller machines, and other equipment. This invention is intended to meet the accessibility requirements of Section 508 of the Rehabilitation Act. The invention consists primarily of specially-designed buttons that allow users to select items from lists that appear on a screen. The selected items get stored into a list of settings that the user submits to the product. The device includes numerous accommodations for persons with disabilities, including a simple user interface, raised buttons with familiar shapes, raised button labels, familiar color coding, Braille button labels, synthesized voice output, headset jacks, sound volume adjustment controls, high contrast and low glare screen, large text font, changeable settings, and the ability to move the device from the product onto the user's lap.
Many products, such as photocopiers and facsimile machines, are not accessible to persons with disabilities. For example, users who are blind cannot operate the touch screens that are on most photocopiers. It is not cost-effective to design different user interface devices to accommodate users with different disabilities.
We need a simple device that allows persons with most disabilities to use a product. To be cost-effective, this device should also allow persons without disabilities to use the product. This device should be simple, consistent, obvious, changeable, and reasonably priced. Users should not need training to learn how to use the device.
The User Interface Device for Improved Accessibility consists primarily of buttons that allow users to select items from lists that appear on a screen. These items get stored into a list of settings that the user submits to the product. The device includes numerous accommodations for persons with disabilities, including a simple user interface, raised buttons with familiar shapes, raised button labels, familiar color coding, Braille button labels, synthesized voice output, headset jacks, sound volume adjustment controls, high contrast and low glare screen, large text font, changeable settings, and the ability to move the device from the product onto the user's lap.
The User Interface Device for Improved Accessibility is shown in Figure 1.
Figure 1. User interface device for improved accessibility
The device consists of:
The user operates the product by using a selection cursor and a select key to select items from lists, then submitting the selected items to the product. There are three lists.
The selection cursor is a visual highlight (e.g., inverse video) that identifies the current item that the user can select. To move the selection cursor between the three lists, the user presses the left and right arrow buttons. To move the selection cursor within a list, the user presses the up and down arrow buttons. If the selection cursor is on the bottom item in a list (e.g., "End of Lists") and the user presses the down arrow button, the selection cursor goes to the top item in the list (e.g., "Lists"). If the selection cursor is on the top item in a list (e.g., "Lists") and the user presses the up arrow button, the selection cursor goes to the bottom item in the list (e.g., "End of Lists").
To assist users who need to scroll to select an item that is far down a list (e.g., to scroll down from "1 copy" to "135 copies"), the up and down arrow buttons repeat (scroll more quickly through a list) when the user holds down the up or down arrow button down for a changeable period of time (e.g., two seconds or higher). None of the other buttons is repeating. To reduce potential user confusion, eliminate errors from moving between different user entry modes, control costs, and reduce the size of the device, the current design of the device does not include a separate number pad.
The user cannot move the selection cursor past the far left list or past the far right list. When the selection cursor is in the far left list and the user presses the left arrow button, the selection cursor does not leave its current position. When the selection cursor is in the far right list and the user presses the right arrow button, the selection cursor does not leave its current position.
To select an item, the user presses the select button. When the user selects a list in the Lists list, the list name is highlighted (e.g., the text for the list name appears bold), the contents of the list appear in the Opened List Items area as a list of items, and the selection cursor appears on the first item in the Opened List Items list. When the user selects an item in the Opened List Items list, the item name is highlighted (e.g., the text for the item appears bold), the selected item appears in the Settings list, and the selection cursor remains on the selected item in the Lists list. When the user selects a setting in the Settings list, then the list in which the setting is located is highlighted in the Lists list, the contents of the list appear in the Opened List Items list, and the selection cursor appears on the setting in the Opened List Items list.
If the user selects a different item in the same list, and the items are mutually exclusive (e.g., a photocopier can use only one paper tray at a time), then the original item is replaced in the Settings list with the item that the user just selected. The user cannot select the item at the top of a list (e.g., "Lists") or at the bottom of a list (e.g., "End of Lists").
If a list is open, and the user moves the selection cursor left or right to another list, the opened lists stay open. So, if the selection cursor is in the Lists list, a list is open, and the user moves the arrow to the right, the opened list remains open. If the selection cursor is in the Opened List Items list, a list is open and the user moves the cursor to the left or right, the opened list remains open. If the selection cursor is in the Settings list, and the user moves the arrow to the left, the items in the Settings list remain in the Settings list.
To undo the last selection (e.g., "4 copies") or to cancel an ongoing device operation (e.g., photocopying), the user presses the cancel button. If the user selected an item in the Lists list, then the user presses the cancel button, the list name is un-highlighted (e.g., the text for the list name changes from bold text to a normal font), the contents of the list disappear from the Opened List Items area, and the selection cursor appears at the top of the Lists list. If the user selected an item in the Opened List Items list, then the user presses the cancel button, the item name is un-highlighted (e.g., the text for the item name changes from bold text to a normal font), the selected item disappears from the Settings list, and the selection cursor appears at the top of the Opened List Items list. If the user selected an item in the Settings list, and then the user presses the cancel button, the item in the Settings list disappears, the list in which the setting was located un-highlights in the Lists list (e.g., the list name appears in normal font), the contents of the list disappears from the Opened List Items list, and the selection cursor appears at the top of the Settings list. If the user submitted a list of settings, the operation is being performed by the product, and then the user presses the cancel button, the device stops the ongoing operation, retains the settings, the selection cursor goes to the top of the Settings list, and a message appears asking the user "To cancel all the settings, press the cancel button again." If the user presses the cancel button after the ongoing product operation stops, then all settings in the Settings list disappear. If the user presses the go button after the ongoing product operation stops, then the product operation resumes. The user can also change the settings in the interrupted operation by using the arrow buttons and select key in the usual ways.
To submit the items in the Settings list, the user presses the go button. When the user presses the go button, the product performs the operations described by the selected settings, the settings remain in the Settings list, the opened list remains highlighted in the Lists list, the list items for the list remain open in the Opened List Items list, and the selection cursor appears at the top of the Settings list. If the selection cursor is on a list item, the user did not select the item, and the user presses the go button, that item is not included in the submitted Settings list.
To accommodate noisy environments, the user can adjust the sound volume up to 85dB. The device automatically resets the sound volume for the external speaker and headset jacks to the changeable default level after the user presses the go button or after the device times out and returns to the default settings. The user can turn off the voice and sound output by turning the audio adjustment wheel down to its lowest setting, then past an obvious detent to the off position.
To save time for the user, the screen may appear with a selected Lists list item (e.g., "Number of copies"), Opened List Items item (e.g., selection cursor is on "1 copy"), and several simple, frequently used default items in the Settings list (e.g., "Copy one-sided original to one-sided copy," "1 copy").
To make it clearer that an item is a list name (e.g., "Stapling") versus an item in an opened list (e.g., "Staple top left corner") the software uses different grammatical forms. So, where possible, list names are gerunds (e.g., "Stapling") and items in an opened list are verbs (e.g., "Staple top left corner." Also, where possible, a form of the list name (e.g., "Stapling") is repeated in an item name (e.g., "Staple top left corner").
To accommodate different environments and user preferences, the device includes changeable system settings such as timeout duration, repeating key duration, sound volume default, device Settings default, timeout warning period, screen font size, and voice output repeat timeout. To allow users to change these system settings, some of the Lists lists include system settings (e.g., "Changing system sound volume," "Changing system timeout duration") that allow the user to select different system settings (e.g., "Change system sound volume to 10," "Change system timeout duration to 5 minutes").
The headset jacks use industry standard connectors (e.g., 2.5mm, 3.5mm) that allow users to plug in their headphones or personal listening devices (e.g., cellular telephone headset, portable stereo headset). When the user plugs in a headset, the external speaker automatically turns off. The user can turn off the headset jack voice and sound output by turning the headset jack audio adjustment wheel down to its lowest setting, then past an obvious detent to the off position. The headset jack volume and the external speaker volume work independently, except that the external speaker turns off when the user plugs a headset into the headset jack.
As an option for products that require the user to frequently enter numbers (e.g., facsimile machines, factory control machines), the device may include a number pad. The number pad uses the telephone button layout and includes a nub on the "5" button, a backspace button to erase the prior number(s) that the user typed in, raised button labels, and buttons for a decimal point and a space. The numbers that the user types in appear on an entry field on the screen. As the user types, the voice output system reads each number, backspace, decimal point, and space. The user submits the numeric entry by pressing the Go button. The user can get out of the numeric entry and remove the entry field on the screen by pressing the cancel button.
To assist blind users, the shapes of the buttons reflect their functions. The left arrow is shaped like a left arrow. The right arrow is shaped like a right arrow. The up arrow is shaped like an up arrow. The down arrow is shaped like down arrow. The "Select" button is shaped like a circle. The "Cancel" button is octagonal, like a stop sign. The "Go" button is larger than the other buttons and is shaped like a rectangle. The "Pause" button is shaped like the rectangle on the pause button of an audio or videocassette recorder. The "Restart" button is shaped like a rectangle. The letters in the labels for each button are raised so that users can "read" the alphabetic labels by touch. To assist blind Braille readers, the label of each button also appears in raised Braille.
To assist users who are blind, the buttons are raised at least 0.8 mm (1/32 inch). The buttons have snap action feedback (a gradual increase followed by a sharp decrease in force required to actuate the key, and a subsequent increase in force beyond this point for cushioning. The required force is from 0.25 N to 1.5 N or 28g to 142g). The button travel is in the range of 1.3 mm to 6.4 mm. The gap between buttons is at least 9.5mm (3/8 inch). The buttons are anti-glare and matte finished with a rubbery material. All control labels are high contrast.
To assist users with low vision, the screen is high contrast, has adjustable contrast, is anti-glare, and uses a large changeable font (e.g., 18 point or higher). To improve readability, all text is mixed case (e.g., "Staple top left corner"). To reduce potential touch errors, eliminate confusing modes, and reduce costs, the screen is not touch sensitive.
To assist users who have low vision or are blind, the device includes synthesized voice output and sounds. When the user moves the cursor to the top of a list (e.g., Settings list), the voice output says the name of the list (e.g., "Settings"). When the user moves the selection cursor onto an item (except for the top and bottom items in a list), the voice output says the name of the item (e.g., "Copying"). When the user presses the select button (except for the top and bottom items in a list) (e.g., user selects "Stapling" in Lists list), the voice output says the name of the item that was selected followed by the word "selected" (e.g., "Stapling selected"), and, because the selection cursor moves automatically to another item, the voice output says the name of that item (e.g., "Staple top left corner"). To allow for quicker user interactions, the user can continue to navigate and make selections and other button presses before a voice output is finished being said. If the user presses another button before the voice output is completed, the current voice output is immediately cut off and the voice output says the new selection. When the selection cursor is on the top item in a list (e.g., "Lists") or the bottom item in a list (e.g., "End of Lists"), and the user presses the select button, the device emits an error tone. When the user presses the cancel button, the voice output says the name of the item that is cancelled followed by the word "cancelled" (e.g., "Staple top left corner cancelled"). When the user tries to move the selection cursor to the left of the furthest left list, the selection cursor does not move, and the device emits an error tone. When the user tries to move the selection cursor to the right of the furthest right list, the selection cursor does not move, and the device emits an error tone. When there is an error message, the device emits an error tone, the selection cursor remains in its current position, the error message appears on the screen, and the device says the error message. To pause a voice output, the user presses the pause button (the button stays in the down position). To resume the voice output at the point at which the user paused it, the user presses the pause button again (the button returns to the raised position). If the user continues to make selections while the pause button is down, the voice output says the selections. To replay a voice output, the user presses the restart button. As an option, the user can change the voice output to another language. To make the device easier to walk up and use, to eliminate training requirements, to eliminate a major source of input errors, and to reduce cost (e.g., design, production, maintenance, upgrade, support) the device does not use voice input.
To assist cognitively challenged users, the user interface for the device is very simple. The device uses both text and graphics. The device also uses familiar shapes and colors. The left arrow is labeled "Left," is shaped like a left arrow, and is white with black text. The right arrow is labeled "Right," is shaped like a right arrow, and is white with black text. The "Up" arrow is labeled "Up," is shaped like an up arrow, and is white with black text. The "Down" arrow is labeled "Down," is shaped like a down arrow, and is white with black text. The "Select" button is labeled "Select," has a green rectangle on it (like the international symbol for an "Enter" sign for a parking lot), is round, and is white with black text. The screen contrast wheel is labeled with text, Braille, and icons for high and low contrast. The audio adjustment wheels are labeled with text, Braille, and a large graphic of an ear for "Louder" and a small graphic of an ear for "Quieter." The "Pause" button is labeled with text, Braille, and the same rectangular graphic that appears on audio and videocassette recorders. The "Restart" button is labeled with text, Braille, and the same left arrow graphic that appears on audio and videocassette recorders. The List list names generally end in "ing" (e.g., Stapling) and the Opened List Items list items start with the list name (e.g., "Staple top left corner"). The headset jacks are labeled with text, Braille, and a graphic of a headset. The controls and the display are arranged in a logical, natural, left to right order that is similar to the order in which the user operates the controls. If the user does not press a button after a changeable period of time, voice output messages automatically repeat. To give users adequate time to make their selections and entries, the device returns to a default state after no button press is detected after a changeable period of time. Before the device returns to the default setting, the device emits a beep and provides a message telling the user that the device will return to the default settings in a changeable number of seconds unless the user presses the cancel button. If the user presses the cancel button within the required period after the device presents the timeout warning, the timeout resets back to the beginning of the timeout period.
To assist users who have mobility challenges, the device includes a long cord so that users (e.g., users in wheelchairs) can put the device conveniently in their laps. To eliminate tension in the cord that might make it hard for weaker users to hold the device, the cord does not have coils in it and does not have an automatic cord retractor. To make it more obvious that users can move the device into their laps, the cord may dangle down along the front of the product. The cord is long enough so that users in wheelchairs can put the device in their laps, but short enough so that when a user drops the device, it does not bang against the floor. The cord includes a connector that takes the strain of dropping the device off of the cord. Users can very easily remove the device from the product (e.g., it has no latches or connectors). Users with strength or movement challenges can put the device in their laps and use their wheelchair arms or their legs as armrests to rest or steady their arms while using the device.
To assist deaf-blind users, the device includes a serial port and a device driver that allow users to connect a refreshable Braille output assistive technology product (such as Braille Lite 40 by Freedom Scientific, SuperBraille 2000 by Advanced Access Devices, BrailleNote BT by Pulse Data HumanWare). The device sends a textual version of the voice output to the refreshable Braille output device.