(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) (12) 根据《专利合作条约》(PCT)公布的国际申请
(19) World Intellectual Property (19) 世界知识产权组织
Organization组织
International Bureau国际局
(43) International Publication Date 6 June 2013 (06.06.2013) (43) 国际公布日 2013 年 6 月 6 日 (06.06.2013)
(10) International Publication Number (10) 国际公布号
WO 2013/081671 A1
(51) International Patent Classification: (51) 国际专利分类号：
G06F 3/042 (2006.01)
(21) International Application Number: (21) 国际申请号:
PCT/US2012/044055
(22) International Filing Date: (22) 国际申请日:
Declarations under Rule 4.17: 根据《专利实施细则》第 4.17 条的声明：
of inventorship (Rule 4.17(iv)) 关于发明人身份的声明（实施细则第 4.17 条第 4 款）
Published:公开日期：
with international search report (Art. 21(3)) 附国际检索报告（第 21 条第 3 款）
(54) Title: COMPENSATING FOR INTERFERENCE AND CONTAMINATION FOR MULTI-TOUCH INPUT DEVICES (54) 发明名称：多触点输入设备的干扰与污染补偿方法
Figure 1: FIG. 5图 1：图 5
\captionsetup{labelformat=empty}
(57) Abstract: Compensation can be performed for interference and/or contamination for multi-touch input devices that use frustrated total internal reflection (FTIR) techniques. Interference, such as infrared interference, can be compensated for by capturing a first digital image with an infrared light source of the input device turned off, capturing a second digital image with the infrared light source turned on, and processing the first and second digital images to compensate for (e.g., remove, filter, and/or subtract) the infrared interference. Contamination, such as dirt, dust, and other types of debris, can be compensated for by capturing a first digital image when the interface panel of the input device is not being touched, and capturing additional digital images during use of the input device. The additional digital images can be processed to compensate for contamination using the first digital image. (57) 摘要：针对采用受抑全内反射(FTIR)技术的多点触控输入设备，可对干扰和/或污染进行补偿。红外等干扰的补偿方法包括：关闭输入设备的红外光源采集第一数字图像，开启红外光源采集第二数字图像，通过处理两幅图像实现红外干扰补偿（如消除、过滤和/或扣除）。对于污垢、灰尘等污染物，可在输入设备面板未被触碰时采集第一数字图像，使用过程中采集更多数字图像，并基于第一图像对这些图像进行处理以实现污染补偿。
COMPENSATING FOR INTERFERENCE AND CONTAMINATION FOR MULTI-TOUCH INPUT DEVICES 多点触控输入设备的干扰与污染补偿方法
CROSS REFERENCE TO RELATED APPLICATION 交叉引用相关申请
[001] This application claims priority to U.S. Provisional Application No. 61/565,494, filed on November 30, 2011, which is incorporated herein in its entirety by reference. [001] 本申请要求 2011 年 11 月 30 日提交的美国临时申请第 61/565,494 号的优先权，该申请通过引用整体并入本文。
BACKGROUND背景技术
[002] Traditional keyboards, mice, and touchpads suffer from a number of limitations. For example, traditional keyboards with mechanical keys can collect debris, such as dirt, germs, and other types of undesirable material. Cleaning a traditional keyboard can be problematic and time consuming. Because a traditional keyboard has an uneven surface (e.g., individual key shapes and gaps between keys), wiping the surface down may not be very effective. Furthermore, cleaning between, behind, or underneath keys may be impractical or impossible (e.g., without removing the keys). [002] 传统键盘、鼠标和触控板存在诸多局限性。例如，带有机械按键的传统键盘容易积聚碎屑，如灰尘、细菌和其他类型的有害物质。清洁传统键盘既麻烦又耗时。由于传统键盘表面不平整（例如单个键帽形状和键间缝隙），简单擦拭表面可能效果不佳。此外，清洁按键之间、后方或下方的区域可能不切实际甚至无法实现（例如不拆除键帽的情况下）。
[003] Traditional keyboards, mice, and touchpads may not be suitable for environments where debris is common, such as an industrial or manufacturing environment where dirt, grease, or other debris may interfere with the proper functioning of the keyboard, mouse, or touchpad. A keyboard cover, such as a clear plastic or silicon cover, may provide some protection in such an environment, but it may also interfere or degrade performance of the device, such as the ability to depress single keys precisely. [003] 传统键盘、鼠标和触控板可能不适用于存在碎屑的常见环境，例如工业或制造环境中，灰尘、油脂或其他碎屑可能会干扰键盘、鼠标或触控板的正常运作。键盘保护罩（如透明塑料或硅胶罩）在此类环境中可提供一定保护，但也可能干扰设备性能或导致操作精度下降，例如影响单键精准按压。
[004] Traditional keyboards, mice, and touchpads may not be suitable for environments where a clean and sterile surface is needed, such as in a health care or hospital environment. For example, a keyboard, mouse, or touchpad surface may have gaps, edges, crevices, or other surface areas that are difficult to clean or sanitize. [004] 传统键盘、鼠标和触控板可能不适用于需要洁净无菌表面的环境，例如医疗保健或医院环境。这些设备的表面可能存在缝隙、边缘、凹槽或其他难以清洁消毒的区域。
[005] In addition, traditional keyboards, mice, and touchpads provide a fixed input configuration. For example, mechanical keyboards are created with keys of fixed size and layout. Similarly, mice have fixed buttons and scroll wheels, and touchpads have a fixed input area. While software can be used to map fixed keyboard keys to new functions, it cannot change the physical size, position, or layout of the keys. [005] 此外，传统键盘、鼠标和触控板都采用固定输入配置。例如机械键盘的按键尺寸与布局固定不变，鼠标的按键和滚轮位置固定，触控板的输入区域也无法改变。虽然可通过软件将固定键盘按键映射为新功能，但无法改变按键的物理尺寸、位置或布局。
[006] Therefore, ample opportunity exists to improve technologies related to multitouch input devices. [006] 因此，多触点输入设备相关技术仍存在广阔的改进空间。
SUMMARY发明内容
[007] This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. [007] 本摘要旨在以简化形式介绍部分概念，这些概念将在具体实施方式中进一步详细说明。本摘要既无意标识要求保护主题的关键特征或必要特征，也无意用于限定要求保护主题的范围。
[008] Technologies, techniques, and tools are described for multi-touch input devices utilizing frustrated total internal reflection (FTIR) techniques. For example, a FTIR multi-touch input device can comprise a base portion, a transparent interface panel connected to the base portion, an interface map attached to the interface panel, an infrared light source for emitting infrared light inside the interface panel using total internal reflection, and one or more digital cameras, where the one or more digital cameras are configured to detect infrared light that is scattered from the interface panel using FTIR when the interface panel is touched. The interface map can be a custom or pre-defined removably attached interface map (e.g., a transparent polycarbonate film). The interface map can depict a layout comprising one or more touch areas (e.g., one or more keys and/or one or more touchpad zones). [008] 本文描述了利用受抑全内反射(FTIR)技术的多点触控输入设备相关技术、工艺及工具。例如，一种 FTIR 多点触控输入设备可包括：基座部分、与基座相连的透明界面面板、附着于界面面板的界面贴膜、用于通过全内反射在界面面板内部发射红外线的红外光源，以及一台或多台数码相机——当界面面板被触摸时，这些数码相机配置用于检测通过 FTIR 从界面面板散射的红外光。所述界面贴膜可以是可拆卸式定制或预定义界面贴膜（如透明聚碳酸酯薄膜），其可呈现包含一个或多个触控区域（例如一个或多个按键和/或一个或多个触控板区域）的布局设计。
[009] As another example, a method can be provided for creating a custom interface map for a multi-touch input device (e.g., a frustrated total internal reflection (FTIR) multi-touch input device). The method can comprise receiving layout information for a custom interface map, where the layout information defines a plurality of touch areas, and where each touch area is one of a key and a touchpad [009] 作为另一示例，可提供一种为多点触控输入设备（例如受抑全内反射式(FTIR)多点触控输入设备）创建自定义界面映射的方法。该方法可包括接收自定义界面映射的布局信息，其中所述布局信息定义多个触控区域，且每个触控区域为按键或触摸板中的一种。
zone, generating a layout for the custom interface map according to the layout information, and generating a configuration file from the received layout information, where the configuration file is loadable on the multi-touch input device to configure the multi-touch input device to use the custom interface map. The method can also comprise outputting the configuration file (e.g., storing the configuration file or sending the configuration file to a user) and/or providing the layout for printing on a transparent film to create the custom interface map. 区域，根据布局信息生成定制界面地图的布局，并从接收到的布局信息生成配置文件，该配置文件可加载至多点触控输入设备以配置设备使用该定制界面地图。该方法还可包括输出配置文件（例如存储配置文件或将配置文件发送给用户）和/或提供布局用于透明薄膜印刷以制作定制界面地图。
[010] As another example, a FTIR multi-touch input device can comprise a base portion, a transparent interface panel connected to the base portion, an infrared light source for emitting infrared light inside the interface panel using total internal reflection, an ultraviolet light source for emitting ultra-violet light inside the transparent interface panel, and one or more digital cameras, where the one or more digital cameras are configured to detect infrared light that is scattered from the interface panel using FTIR when the interface panel is touched. The ultraviolet light can provide a sterilization effect to the transparent interface panel. [010] 作为另一示例，一种 FTIR 多点触控输入装置可包括基座部分、与基座部分连接的透明界面面板、用于通过全内反射在界面面板内部发射红外光的红外光源、用于在透明界面面板内部发射紫外光的紫外光源以及一个或多个数码相机，其中所述一个或多个数码相机被配置为当界面面板被触摸时检测通过 FTIR 从界面面板散射的红外光。所述紫外光可对透明界面面板提供杀菌效果。
[011] As another example, a custom interface map and configuration file can be provided for a multi-touch input device (e.g., a FTIR multi-touch input device), comprising a custom interface map that is defined by layout information, where the layout information comprises, for each of a plurality of touch areas: configuration of the touch area, location of the touch area on the custom interface map, and function performed by the touch area when touched, and comprising a configuration file corresponding to the custom interface map, where the configuration file is loadable on the multi-touch input device to configure the multi-touch input device to use the custom interface map and process touch events according to the layout information. [011] 作为另一示例，可为多点触控输入设备（例如 FTIR 多点触控输入设备）提供定制界面映射和配置文件，该定制界面映射由布局信息定义，其中所述布局信息针对多个触控区域中的每一个包含：触控区域的配置、触控区域在定制界面映射上的位置、以及触控区域被触摸时执行的功能；并包含与定制界面映射对应的配置文件，该配置文件可加载至多点触控输入设备上，以配置设备使用该定制界面映射并根据布局信息处理触控事件。
[012] As another example, a method, implemented at least in part by a frustrated total internal reflection multi-touch input device, can be provided for removing interference. The method can comprise capturing a first digital image, where the first digital image is captured when an infrared light source of the FTIR multi-touch input device is turned off, capturing a second digital image, where the second digital image is captured when the infrared light source of the FTIR multi-touch input [012] 作为另一示例，可提供一种至少部分通过受抑全内反射多点触控输入设备实现的方法来消除干扰。该方法可包括：捕获第一数字图像（其中第一数字图像是在 FTIR 多点触控输入设备的红外光源关闭时采集的），捕获第二数字图像（其中第二数字图像是在 FTIR 多点触控输入
device is turned on, and processing the first and second digital images to remove infrared interference. 设备的红外光源开启时采集的），以及处理第一和第二数字图像以消除红外干扰。
[013] As another example, a frustrated total internal reflection multi-touch input device can comprise a transparent interface panel, an infrared light source for emitting infrared light inside the interface panel using total internal reflection, and a digital camera, where the digital camera is configured to detect infrared light that is scattered from the interface panel using FTIR when the interface panel is touched. The input device can be configured to perform operations comprising detecting infrared interference based at least in part from digital images captured using the digital camera when the infrared light source is off, and compensating for the detected infrared interference in digital images captured using the digital camera when the infrared light source is on [013] 作为另一示例，一种受抑全内反射多点触控输入装置可包含透明界面面板、利用全内反射在界面面板内部发射红外线的红外光源以及数码相机，其中该数码相机配置用于在界面面板被触摸时检测通过 FTIR 从界面面板散射的红外光。该输入装置可配置执行包括以下步骤的操作：至少部分基于红外光源关闭时数码相机捕获的数字图像检测红外干扰，并对红外光源开启时数码相机捕获的数字图像中检测到的红外干扰进行补偿。
[014] As yet another example, a method, implemented at least in part by a frustrated total internal reflection multi-touch input device, can be provided for removing contamination from digital images. The method can comprise capturing a first digital image, where the first digital image is captured when an infrared light source of the FTIR multi-touch input device is turned on, and where the first digital image is captured when an interface panel of the FTIR multi-touch input device is not being touched, determining contamination information based at least in part upon the first digital image, where the contamination information is determined from detected infrared light present in the first digital image, capturing a plurality of additional digital images, where the plurality of additional digital images are captured when the infrared light source of the FTIR multi-touch input device is turned on, and processing the plurality of additional digital images based at least in part upon the contamination information to remove contamination from the plurality of additional digital images [014] 作为又一示例，可提供一种至少部分通过受抑全内反射多点触控输入设备实现的方法，用于消除数字图像中的污染。该方法可包括：采集第一数字图像（其中该第一数字图像是在 FTIR 多点触控输入设备的红外光源开启时采集的，且采集时设备界面面板未被触碰）；至少部分基于第一数字图像确定污染信息（其中该污染信息是从第一数字图像中检测到的红外光得出）；采集多幅附加数字图像（其中这些附加数字图像是在 FTIR 多点触控输入设备的红外光源开启时采集的）；以及至少部分基于所述污染信息处理多幅附加数字图像以消除其中的污染。
[015] As described herein, a variety of other features and advantages can be incorporated into the technologies as desired. [015] 如本文所述，可根据需要将多种其他特性和优势融入所述技术中。
BRIEF DESCRIPTION OF THE DRAWINGS 附图简要说明
[016] FIG. 1 is a perspective view depicting an example multi-touch input device, which can be in the format of a keyboard. [016] 图 1 是展示示例性多点触控输入设备的透视图，该设备可采用键盘形式。
[017] FIG. 2 is a perspective view depicting an example multi-touch input device, which can be in the format of a mouse or touchpad. [017] 图 2 是展示示例性多点触控输入设备的透视图，该设备可采用鼠标或触摸板形式。
[018] FIG. 3 is a side elevation view of the multi-touch input device of Fig. 1 or Fig. 2. [018] 图 3 是图 1 或图 2 所示多触点输入设备的侧视图。
[019] FIG. 4 is an exploded view depicting an example multi-touch input device. [019] 图 4 是示例性多触点输入设备的分解示意图。
[020] FIG. 5 is a schematic side elevation view of an example multi-touch input device in use, depicting scattered IR light from a touch. [020] 图 5 是使用中的示例性多触点输入设备原理侧视图，显示了触点引发的红外光散射现象。
[021] FIGS. 6A and 6B are plan views of example interface maps with a keyboard layout. [021] 图 6A 和 6B 是带有键盘布局的示例性界面映射平面图。
[022] FIG. 7 is a plan view of an example interface map with a mouse or touchpad layout. [022] 图 7 为采用鼠标或触摸板布局的示例界面示意图。
[023] FIG. 8 is a flowchart of an exemplary method for creating a custom interface map for a multi-touch input device. [023] 图 8 是为多点触控输入设备创建自定义界面映射的示例方法流程图。
[024] FIGS. 9A, 9B, and 9C are diagrams depicting example digital images, including images depicting infrared interference. [024] 图 9A、9B 和 9C 为示例数字图像示意图，包含显示红外干扰的图像。
[025] FIG. 10 is a flowchart of an exemplary method for removing infrared interference. [025] 图 10 是消除红外干扰的示例方法流程图。
[026] FIGS. 11A, 11B, and 11C are diagrams depicting example digital images, including images depicting scattered light from contamination. [026] 图 11A、11B 和 11C 是展示示例数字图像的示意图，包括描绘污染物散射光的图像。
[027] FIG. 12 is a flowchart of an exemplary method for removing contamination from digital images. [027] 图 12 是用于去除数字图像中污染物的示例方法流程图。
[028] FIG. 13 is a system diagram depicting a generalized example of a suitable computing system in which the described innovations may be implemented [028] 图 13 是系统示意图，展示了一个适合实施所述创新技术的通用计算系统示例
DETAILED DESCRIPTION具体实施方式
[029] Before beginning a detailed description of the multi-touch input device, mention of the following is in order. When appropriate, like reference materials and characters are used to designate identical, corresponding, or similar components in differing figure drawings. The figure drawings associated with this disclosure typically are not drawn with dimensional accuracy to scale, i.e., such drawings have been drafted with a focus on clarity of viewing and understanding rather than dimensional accuracy. [029] 在详细描述多点触控输入设备之前，有必要作如下说明。在适用情况下，不同附图将采用相同的参考标记和符号来指代完全一致、相互对应或近似的组件。本说明书所涉及的附图通常未按实际尺寸比例绘制，即此类图纸的绘制侧重于展示清晰度和可理解性，而非尺寸精确度。
[030] The following description is directed to aspects of touch panel input devices utilizing frustrated total internal reflection (FTIR) techniques. Multi-touch input devices can be provided in the format of keyboards, mice, touchpads, or combinations thereof. For example, a multi-touch input device can be provided in the format of a traditional keyboard, comprising letter keys, number keys, function keys, special keys, etc. A multi-touch input device can be provided in the format of a mouse or touchpad, comprising a touchpad zone for cursor movement and one or more buttons. A multi-touch input device can also comprise functionality of a keyboard in addition to a mouse or touchpad. For example, a layout for a multitouch input device can comprise keys and buttons in combination with touchpad zones (e.g., in a pre-defined or user-defined layout). [030] 本说明书涉及采用受抑全内反射(FTIR)技术的触控面板输入装置。多触点输入装置可呈现为键盘、鼠标、触控板或其组合形式。例如，多触点输入装置可采用传统键盘形式，包含字母键、数字键、功能键、特殊键等；也可采用鼠标或触控板形式，包含用于光标移动的触控区域及一个或多个按键；还可兼具键盘与鼠标/触控板功能。举例而言，多触点输入装置的布局可整合按键与触控区域（例如采用预定义或用户自定义布局）。
[031] In any of the examples herein, a multi-touch input device (e.g., keyboard, mouse, touchpad, and the like) can have a touch sensitive surface (e.g., an interface panel) implemented, at least in part, using FTIR techniques. For example, the touch sensitive surface can be a sheet of material, such as glass or plastic, within which light (e.g., infrared (IR), ultraviolet (UV), and/or visible light) is reflected internally (e.g., via total internal reflection). In some implementations, the interface panel is made from glass or a glass blend, such as a borosilicate type glass. [031] 在本文任何示例中，多触点输入设备（例如键盘、鼠标、触控板等）可配置采用至少部分基于受抑全内反射（FTIR）技术实现的触敏表面（例如接口面板）。例如，该触敏表面可以是玻璃或塑料等材料制成的薄片，其内部通过全反射方式传导光线（如红外线、紫外线及/或可见光）。某些实施方案中，接口面板采用硼硅酸盐类玻璃或玻璃复合材料制成。
[032] The size or dimensions of a multi-touch input device can vary according to implementation details. For example, a multi-touch input device that will be used as a traditional keyboard can be sized similarly to a traditional keyboard. An input device that will be used as a touchpad with a small number of buttons can be sized accordingly (e.g., smaller than a traditional keyboard). [032] 多触点输入设备的尺寸规格可根据具体实施方案进行调整。例如，拟用作传统键盘的多触点输入设备，其尺寸可设计为与传统键盘相仿；而拟用作带少量按键的触控板的输入设备，则可相应缩小尺寸（例如小于传统键盘）。
[033] Multi-touch input devices can detect touch by an object (e.g., a person’s finger, stylus, or other type of object) using FTIR technology. Multi-touch input devices can detect touch by more than one object (e.g., multiple fingers) at once (e.g., by imaging the interface panel to detect one or more touch events as spots or blobs of scattered IR light). [033] 多点触控输入设备可利用 FTIR 技术检测物体（如人的手指、触控笔或其他类型物体）的触摸操作。这类设备能同时检测多个物体（如多根手指）的触控行为（例如通过对界面面板进行成像，将检测到的一个或多个触控事件识别为红外光散射形成的斑点或光斑）。
[034] In some implementations, a multi-touch keyboard, mouse, or touchpad has a glass touch area where activation of standard keys or manipulation of 1D or 2D sliders can occur (e.g., 1D volume control or zoom sliders, or 2D cursor movement zones). The multi-touch input device can be supported by a base part that houses control circuitry, cameras, communication connections, and/or a battery. The input device can have raised surface indicators (e.g., small bumps) to indicate specific locations on the surface to a user (e.g., bumps on the J\mathbf{J} and F keys to help with finger placement). The input device can provide (e.g., via software or firmware) selectable functions to create keystroke sounds for each touch. The input device can include a backlight that can be turned on or off. [034] 在某些实施方案中，多点触控键盘、鼠标或触控板设有玻璃触控区域，可在此实现标准按键的激活或一维/二维滑块的操控（如一维音量控制/缩放滑块，或二维光标移动区域）。该多点触控输入设备可由底座部件支撑，底座内装有控制电路、摄像头、通信接口和/或电池。输入设备表面可设置凸起标识（如微小凸点）向用户指示特定位置（例如在 J\mathbf{J} 键和 F 键上的凸点辅助手指定位）。该设备可通过（软件或固件提供的）可选功能为每次触控生成按键音效，并可能配备可开关的背光功能。
[035] FTIR technology can use infrared light-emitting diodes (LEDs) placed at the edge of a panel which transmits the wavelength(s) of light produced by the LEDs. Because of the low angle at which the light impacts the internal glass surface, it is internally reflected or “bounced around inside the glass,” much like looking through a tube to see the reflections on the inside walls. When the glass is touched it frustrates the reflection and the IR light is scattered, with some of the light being scattered downward, out of the glass, which allows a camera to see it. The device can then determine the location and send the appropriate information to a computer or other computing device. [035] FTIR 技术可利用置于面板边缘的红外发光二极管(LED)，该面板可透射 LED 产生的光波。由于光线以极小的角度入射至玻璃内表面，会在内部发生反射或"在玻璃内部弹跳"，其原理类似于通过管道观察内壁反射的光线。当触碰玻璃表面时，会破坏这种反射状态，导致红外光发生散射，部分光线向下散射并逸出玻璃，从而被摄像头捕捉。设备据此可确定触控位置，并将相应信息传送至计算机或其他计算设备。
[036] The multi-touch input devices described herein can be completely customizable. The interface map can be easily changed by affixing (e.g., placing on or adhering) clear static sheets that can be purchased or printed custom by the end user. This allows the user to adapt to specific languages or dedicate areas of the input device to anything they choose, in addition to selecting standard layouts for users who want to use the number pad area just for track pad function for instance. Flexible software can allow even more versatility by providing the ability to develop special functionality for any desired interface map layout. [036] 本文所述的多点触控输入设备可实现完全定制化。终端用户只需购买或自行打印透明静电贴膜进行覆贴（例如放置或粘附），即可轻松更改界面布局图。这使用户既能适应特定语言需求，又能将输入设备的任意区域指定为自定义功能区域——例如对于仅需将数字键盘区用作触控板功能的用户，也可选择标准布局。灵活的软件还能为任何界面布局图开发特殊功能，从而提供更强大的适应性。
[037] The multi-touch input devices described herein can provide advantages over existing FTIR technology and conventional capacitive touch screen systems. For example, the input device technology described herein can be less expensive and use less power, because the touch panel is separate from the display screen, and no projection apparatus is needed to project the interface map onto the touch panel. In addition custom interface maps can be developed and removably applied to satisfy a variety of standard and special purpose applications. Furthermore, the touch surface can be easily cleaned and can support sterilization techniques. Other advantages of the multi-touch input device technology are described elsewhere herein. [037] 本文所述的多点触控输入设备相较于现有 FTIR 技术及传统电容式触控系统具有多重优势。例如，由于触控面板与显示屏分离且无需投影装置将界面映射投射至触控面板，所述输入设备技术可显著降低制造成本与能耗。此外，可开发可拆卸式定制界面映射以满足各类标准与特殊应用场景。该触控表面还支持便捷清洁与灭菌处理技术。本文其他章节将详述该多点触控输入设备技术的更多优势。
Multi-Touch Input Devices 多点触控输入设备
[038] This section describes different aspects of multi-touch input devices that utilize FTIR techniques. Different features and elements of the devices described in this section can be used separately or in combination with other features and elements described in this section and/or described elsewhere herein. [038] 本节阐述采用 FTIR 技术的多点触控输入设备的不同特性。所述设备的各项功能与组件既可独立使用，亦可与本章节或其他章节描述的技术特征组合实施。
[039] Fig. 1 is a perspective view depicting an example multi-touch input device 100. For example, the multi-touch input device 100 can be in the format of a keyboard. The multi-touch input device 100 comprises a transparent interface panel 102, a base portion 104, a housing portion 107 connecting the interface panel 102 to the base portion 104, a light source (not depicted) for projecting light into the interface panel 102 (e.g., for directing IR light to an edge of the interface panel 102), and one or more digital cameras 116 positioned to scan a surface of the interface [039] 图 1 为示例性多点触控输入设备 100 的透视图。例如，该多点触控输入设备 100 可采用键盘形式。该设备包含透明接口面板 102、底座部分 104、将接口面板 102 与底座部分 104 相连的外壳部分 107、用于向接口面板 102 投射光源(例如将红外光导向面板边缘)的光源组件(未图示)，以及一个或多个设置用于扫描接口面板 102 表面的数码相机 116。
panel 102. The multi-touch input device 100 also comprises an interface map 126 (e.g., a custom or pre-defined interface map), such as a transparent film with a printed layout, affixed to the interface panel 102. 此外，多点触控输入设备 100 还包含固定在接口面板 102 上的界面映射层 126(例如定制或预定义的界面映射)，该映射层可以是带有印刷布局的透明薄膜。
[040] In some embodiments, the digital cameras 116 are mounted in the base portion 104, distal from interface panel 102, in order to provide adequate field of vision. The digital cameras 116 can scan (e.g., continuously capture images or frames a number of times per second, such as 30 or 60 frames per second) at least the area of the interface panel 102 corresponding to the interface map 126. The light source can flicker at a frequency and pulse length which is synchronized with the scan rate of the corresponding digital cameras 116. Synchronizing the light source and the digital cameras 116 can help prevent interference from other potential light sources (e.g., IR light), such as IR remote control devices. Depending on implementation details, the light source and digital cameras 116 can be synchronized at a rate of, for example, 15Hz,30Hz,60Hz15 \mathrm{~Hz}, 30 \mathrm{~Hz}, 60 \mathrm{~Hz}, or at another rate. [040] 在某些实施方式中，数字摄像机 116 安装在底座部分 104 上，远离接口面板 102，以提供足够的视野范围。数字摄像机 116 可对至少与接口映射图 126 相对应的接口面板 102 区域进行扫描（例如以每秒 30 或 60 帧等频率持续捕获图像或帧）。光源能以与对应数字摄像机 116 扫描速率同步的频率和脉冲长度进行闪烁。同步光源与数字摄像机 116 有助于避免其他潜在光源（如红外光）的干扰，例如红外遥控设备。根据具体实施细节，光源与数字摄像机 116 可同步于例如 15Hz,30Hz,60Hz15 \mathrm{~Hz}, 30 \mathrm{~Hz}, 60 \mathrm{~Hz} 或其他速率。
[041] Fig. 2 is a perspective view depicting an example multi-touch input device 200 . For example, the multi-touch input device 200 can be in the format of a touchpad or mouse. The multi-touch input device 200 comprises a transparent interface panel 202, a base portion 204, a housing portion 207 connecting the interface panel 202 to the base portion 204, a light source (not depicted) for projecting light into the interface panel 202, and one or more digital cameras 216 positioned to scan a surface of the interface panel 202. The multi-touch input device 200 also comprises an interface map 226 (e.g., a custom or pre-defined interface map) affixed to the interface panel 202. [041] 图 2 为示例性多点触控输入设备 200 的透视图。例如，该多点触控输入设备 200 可采用触摸板或鼠标的形式。该设备包含透明界面面板 202、底座部分 204、将界面面板 202 与底座部分 204 相连的外壳部分 207、用于向界面面板 202 投射光源的发光元件（未图示），以及设置用于扫描界面面板 202 表面的一个或多个数码摄像头 216。该多点触控输入设备 200 还包含固定在界面面板 202 上的界面映射层 226（例如定制或预定义的界面映射层）。
[042] In some implementations, the multi-touch input devices depicted in Figs. 1 and 2 comprise many of the same design features. For example, the input device of Fig. 2 can be a smaller version (e.g., in width, length, and/or height) of the input device of Fig. 1. The input device of Fig. 2 may have a different interface map 226 (e.g., a touchpad style interface map instead of a keyboard style interface map) and may have a fewer number of digital cameras 216 (e.g., only one digital camera instead of multiple digital cameras). [042] 在某些实施方式中，图 1 和图 2 所示的多点触控输入设备具有许多相同的设计特征。例如，图 2 的输入设备可以是图 1 输入设备的缩小版（例如在宽度、长度和/或高度上）。图 2 的输入设备可能具有不同的界面映射 226（例如采用触控板式界面映射而非键盘式界面映射），并且配备的数字相机 216 数量较少（例如仅有一个数字相机而非多个）。
[043] The multi-touch input devices depicted in Figs. 1 and 2 can be configured for different applications. For example, a larger input device, such as depicted in Fig. 1 can operate as a typical keyboard (e.g., it can operate in place of a standard mechanical keyboard without any special software or drivers). A smaller input device, such as depicted in Fig. 2 can operate as a typical mouse (e.g., it can operate in place of a standard opto-mechanical mouse or touchpad without any special software or drivers). In this way, the input device can be directly connected to a computer system and operate as a keyboard or mouse without the need for additional software or drivers. In addition, while Fig. 1 generally depicts an input device with a keyboard type layout and Fig. 2 generally depicts an input device with a mouse or touchpad type layout, the input devices are not limited to such layouts. For example, the input device depicted in Fig. 2 can be configured (e.g., with a pre-defined or custom layout) with keys performing standard functions (e.g., letters or numbers, such as a number pad) or custom functions (e.g., arbitrary defined key shapes and placement that perform customizable actions when activated). Similarly, the input device depicted in Fig. 1 can be configured with touchpad zones (e.g., including a touchpad zone that performs cursor movement), separately or in combination with keys performing standard or custom functions. [043] 图 1 和图 2 所示的多点触控输入设备可针对不同应用进行配置。例如，图 1 所示的较大输入设备可作为常规键盘使用（例如，它无需任何特殊软件或驱动程序即可替代标准机械键盘运行）。图 2 所示的较小输入设备则可作为常规鼠标使用（例如，它无需任何特殊软件或驱动程序即可替代标准光电鼠标或触控板运行）。通过这种方式，该输入设备可直接连接计算机系统，作为键盘或鼠标运行而无需额外软件或驱动程序。此外，虽然图 1 主要展示的是键盘式布局的输入设备，图 2 主要展示的是鼠标或触控板式布局的输入设备，但这些输入设备并不限于此类布局。例如，图 2 可以配置（例如采用预定义或自定义布局）具有执行标准功能（如字母或数字，例如数字键盘）或自定义功能（例如任意定义的按键形状和位置，激活时可执行可定制操作）的按键。类似地，图 1 所示的输入设备可配置触摸板区域（例如包含执行光标移动的触摸板区域），既可单独使用，也可与执行标准或自定义功能的按键组合使用。
[044] The multi-touch input devices depicted in Figs. 1 and 2 can detect touch events by an object (e.g., a person’s finger, stylus, or other type of object) using FTIR technology. The touch events can be, for example, a touch (e.g., a touch or press by a finger with a large enough area to indicate a user’s desire to activate a key or button), a rest (e.g., a touch or press by a finger for a longer duration to indicate the user does not desire to activate a key or button), a movement (e.g., movement of a touch area over successive frames to indicate a user’s desire to perform a movement action, such as cursor movement on a touchpad zone). [044] 图 1 和图 2 所示的多点触控输入设备可利用 FTIR 技术检测物体（如人的手指、触控笔或其他类型物体）的触摸事件。这些触摸事件可包括：点击（例如手指以足够大的接触面积进行的触摸或按压，表示用户希望激活某个按键）、停留（例如手指较长时间的触摸或按压，表示用户无意激活按键）、移动（例如触摸区域在连续帧间的位移，表示用户希望执行移动操作，如在触摸板区域移动光标）。
[045] The transparent interface panel (e.g., 102 or 202) can be a panel made out of a material, such as glass or plastic, within which light (e.g., infrared (IR), ultraviolet (UV), and/or visible light) is reflected internally. The panel can be a curved panel (e.g., curved in one direction). [045] 透明界面面板（例如 102 或 202）可由玻璃或塑料等材料制成，其内部可反射光线（如红外线（IR）、紫外线（UV）和/或可见光）。该面板可以是曲面面板（例如单向弯曲）。
[046] The base portion (e.g., 104 or 204) of the multi-touch input devices depicted in Figs. 1 and 2 can provide support for the input device and can house various components. For example, the base portion can house the digital cameras (e.g., 116 or 216). The digital cameras can be housed in the base portion in a position to view (e.g., capture images) of the underside of the interface panel (e.g., 102 or 202). The base portion can house components needed for communication with a computing device (e.g., a computer system, such as a desktop computer, or another type of computing device), such as a USB connection and/or wireless communication technology (e.g., Bluetooth). The base portion can house control components (e.g., processors or other types of controllers) for operating the input device (e.g., controlling the digital cameras to scan or image the underside of the interface panel, process the information, and communicate results to an associated computing device). [046] 图 1 和图 2 所示的多点触控输入设备的基座部分（例如 104 或 204）可为输入设备提供支撑，并容纳各种组件。例如，基座部分可容纳数字摄像头（例如 116 或 216）。这些数字摄像头可安装在基座部分中，使其能够观察（例如拍摄）界面面板（例如 102 或 202）底部的图像。基座部分还可容纳与计算设备（例如计算机系统，如台式电脑或其他类型的计算设备）通信所需的组件，如 USB 连接和/或无线通信技术（例如蓝牙）。此外，基座部分可容纳用于操作输入设备的控制组件（例如处理器或其他类型的控制器），包括控制数字摄像头扫描或拍摄界面面板底部图像、处理信息，并将结果传送至关联的计算设备。
[047] The housing portion (e.g., 107 or 207) of the multi-touch input devices depicted in Figs. 1 and 2 can connect the base portion (e.g., 104 or 204) to the interface panel (e.g., 102 or 202). The housing portion can house a light source (e.g., IR, UV, and/or visible light sources, such as LEDs). For example, the light source (e.g., one or more LEDs) can be located in in the housing portion or in the base portion, and be positioned for directing light into an edge of the interface panel (e.g., positioned to directly shine light into the edge of the interface panel or to indirectly conduct light, such as via a light pipe). [047] 图 1 和图 2 所示的多点触控输入设备的壳体部分(例如 107 或 207)可将基座部分(例如 104 或 204)与接口面板(例如 102 或 202)相连接。该壳体部分可容纳光源(如红外线、紫外线和/或可见光源，例如 LED)。举例而言，光源(例如一个或多个 LED)可设置在壳体部分或基座部分内，其位置设计用于将光线导向接口面板边缘(例如直接照射到接口面板边缘的位置，或通过光导管等间接传导光线的位置)。
[048] The light source of the multi-touch input devices depicted in Figs. 1 and 2 can provide UV, IR, and/or visible light. In some implementations, one or more IR LEDs provide a light source within the interface panel, for detection by the digital cameras using FTIR technology. In some implementations, one or more UV LEDs provide a light source to the interface panel and provides a sterilization effect to the interface panel. UV, IR, and/or visible light sources can be used separately or in combination. [048] 图 1 和图 2 所示多点触控输入设备的光源可提供紫外线、红外线和/或可见光。在某些实施方案中，一个或多个红外 LED 为接口面板内部提供光源，供数字相机通过 FTIR 技术进行检测。另一些实施方案中，一个或多个紫外 LED 为接口面板提供光源的同时，还能对接口面板起到杀菌消毒作用。紫外线、红外线和/或可见光源可单独使用，也可组合使用。
[049] The digital cameras (e.g., 116 or 216) of the multi-touch input devices depicted in Figs. 1 and 2 capture images (e.g., continuously capture a sequence of [049] 图 1 和图 2 所示的多点触控输入设备中的数码相机（例如 116 或 216）会拍摄界面面板（例如 102 或 202）的图像（例如持续拍摄一系列
images as a video stream) of the interface panel (e.g., 102 or 202). The digital cameras can be configured to capture at a specific rate (e.g., 30,50 , or 80 pictures or frames per second (FPS)). The digital cameras can be configured to capture at a specific rate that depends on the rate of a light source. For example, if an IR light source is strobing or flashing at a specific rate, such as 15 Hz or 30 Hz (cycles per second), the digital camera capture rate can be set accordingly (e.g., to the same rate, such as 15 Hz or 30 Hz , or to a different rate, such as 30 Hz or 60 Hz , which may be a multiple of the flashing rate of the IR light). The digital cameras can be selected, or filtered, to be primarily sensitive to specific types of light, such as IR light. The digital images captured by the digital cameras can depict the presence and absence of infrared light. For example, the digital images can be grayscale digital images in which areas of detected infrared light are lighter (e.g., where the lighter the grayscale value, the greater the intensity of IR light) and areas with little or no detected infrared light are darker (e.g., where the darker the grayscale value, the lesser the intensity of IR light). 图像作为视频流）。数码相机可配置为以特定速率拍摄（例如每秒 30、50 或 80 张图片或帧数（FPS））。数码相机还可根据光源频率调整拍摄速率，例如当红外光源以 15 赫兹或 30 赫兹（每秒周期数）的特定频率闪烁时，数码相机的拍摄速率可相应设置为相同频率（15 赫兹或 30 赫兹）或不同频率（30 赫兹或 60 赫兹，可以是红外光闪烁频率的整数倍）。所选的数码相机或其滤光片可主要对特定类型的光线（如红外光）敏感。数码相机拍摄的数字图像能呈现红外光的存在与消失状态。 例如，数字图像可以是灰度数字图像，其中检测到红外线的区域较亮（例如，灰度值越亮表示红外线强度越大），而检测到极少或没有红外线的区域较暗（例如，灰度值越暗表示红外线强度越小）。
[050] The multi-touch input devices depicted in Figs. 1 and 2 can include an interface map (e.g., 126 or 226). The interface map depicts a layout for the various key and/or touchpad areas of the input device. For example, the interface map can depict key areas for a standard keyboard (e.g., depicting letters, numbers, special characters, arrow keys, function keys, etc.). In some implementations, the interface map is a separate sheet (e.g., a static plastic sheet) that is removably attached to the top surface of the interface panel (e.g., a separate sheet or film that is placed on the interface panel or adhered to the interface panel). Alternatively, the interface map can be attached to the bottom surface of the interface panel. In some implementations, the interface map is permanently attached to the top or bottom surface of the interface panel (e.g., printed directly on the surface of the interface panel, etched into the interface panel, or otherwise permanently applied or attached). The interface map can be a custom interface map (e.g., user-defined or selected from a number of layout options or combinations of elements) or a pre-defined interface map (e.g., a standard keyboard layout in a specific language). [050] 图 1 和图 2 所示的多点触控输入设备可包含接口映射图（例如 126 或 226）。该接口映射图展示了输入设备上各类按键和/或触控板区域的布局。例如，接口映射图可呈现标准键盘的按键区域（如显示字母、数字、特殊字符、方向键、功能键等）。在某些实施方式中，接口映射图为可拆卸地附着在接口面板顶面的独立片材（例如置于接口面板上或粘附于接口面板的静态塑料片材或薄膜）。或者，接口映射图也可固定于接口面板的底面。另一些实施方式中，接口映射图会永久性地附着在接口面板的顶面或底面（例如直接印刷在接口面板表面、蚀刻于面板中，或以其他方式永久性施加或固定）。 界面映射可以是自定义界面映射（例如用户自定义或从多个布局选项或元素组合中选择），也可以是预定义的界面映射（例如特定语言的标准键盘布局）。
[051] The multi-touch input devices depicted in Figs. 1 and 2 can include a controller (e.g., one or more processors, integrated circuits, and/or associated components). The controller can be located, for example, in the base portion (e.g., 104 or 204) of the multi-touch input device. The controller can control functions of the input device, such as communication (e.g., wired or wireless communication) with an associated computing device, operation of the digital cameras, processing of images to detect touch events, translation of touch events into specific key presses or touchpad movement (e.g., using an interface map), sterilization cleaning cycles, processing of images to remove interference and/or contamination, communication with an associated computer as a standard keyboard and/or mouse, and other functions performed by the input device. [051] 图 1 和图 2 所示的多点触控输入设备可包含控制器（例如一个或多个处理器、集成电路及/或相关组件）。该控制器可位于多点触控输入设备的基座部分（例如 104 或 204）中。控制器可控制输入设备的各项功能，包括：与关联计算设备进行通信（例如有线或无线通信）、数字摄像头的操作、通过图像处理检测触摸事件、将触摸事件转换为特定按键操作或触控板移动（例如使用界面映射）、灭菌清洁循环、通过图像处理消除干扰和/或污染、作为标准键盘和/或鼠标与关联计算机通信，以及输入设备执行的其他功能。
[052] Fig. 3 is a side elevation view of the multi-touch input device 100 of Fig. 1 or 200 of Fig. 2, showing the transparent interface panel 102 or 202, the base portion 104 or 204 , the housing portion 107 or 207 connecting the interface panel to the base portion, a light source (not depicted) for projecting light into the interface panel, and one or more digital cameras 116 or 216 positioned to scan a surface of the interface panel. The multi-touch input device also has the interface map 126, 226 (e.g., a visually perceptible and/or tactile perceptible interface map) attached (e.g., removably attached or permanently attached) to the top 318 (as shown) and/or bottom 320 surface of the interface panel. The interface map can be selected from a plurality of pre-existing layouts or a custom layout can be created for a particular user or purpose. The interface map can be configured in a single piece, or multiple interface map parts can be provided. [052] 图 3 是图 1 所示多触点输入设备 100 或图 2 所示设备 200 的侧视图，展示了透明界面面板 102 或 202、基座部分 104 或 204、将界面面板与基座部分相连的外壳部分 107 或 207、用于向界面面板投射光源的光源组件（未图示）以及一个或多个设置用于扫描界面面板表面的数码相机 116 或 216。该多触点输入设备还配有界面贴图 126、226（例如视觉可感知和/或触觉可感知的界面贴图），可拆卸或永久固定于界面面板的顶部 318（如图所示）和/或底部 320 表面。界面贴图可从多种预设布局中选择，也可根据特定用户或用途创建自定义布局。该贴图可配置为整体式结构，也可提供多个贴图部件组合使用。
[053] As shown in Fig. 3, the base portion 104 or 204 and/or housing portion 107 or 207 can comprise various components for operating the multi-touch input device 100, 200. For example, the components can include controllers (e.g., one or more processors), one or more of the cameras 116 or 216, power supplies, interfaces to other systems (e.g., USB and/or wireless connection components for communicating with other computing devices), LEDs, light pipes, etc. [053] 如图 3 所示，基座部分 104 或 204 和/或外壳部分 107 或 207 可包含用于操作多点触控输入设备 100、200 的各种组件。例如，这些组件可包括控制器（如一个或多个处理器）、一个或多个摄像头 116 或 216、电源、与其他系统的接口（如用于与其他计算设备通信的 USB 和/或无线连接组件）、LED 指示灯、导光管等。
[054] From the side, the multi-touch input device has a streamlined aesthetic appearance. In the examples, the interface panel is slightly curved and attached only at one end, such that its forward edge is cantilevered over the cameras and the forward edge of the base. [054] 从侧面看，该多点触控输入设备具有流线型的美观外观。在所示实施例中，接口面板呈轻微弯曲状且仅在一端固定，使其前缘以悬臂形式延伸覆盖摄像头和基座的前边缘。
[055] Fig. 4 is an exploded view depicting an example multi-touch input device 400. The multi-touch input device 400 comprises a transparent interface panel 402 (e.g., corresponding to 102 or 202), an interface map 426 (e.g., corresponding to 126 or 226), a base portion 404 (e.g., corresponding to 104 or 204) coupled to interface panel 402, a housing portion 407 (e.g., corresponding to 107 or 207) connecting the interface panel 402 to the base portion 404, and three digital cameras 416 positioned to scan a surface of the interface panel 402. Depending on implementation details, a different number of digital cameras 416 can be used. [055] 图 4 为示例性多点触控输入设备 400 的分解示意图。该多点触控输入设备 400 包含透明接口面板 402（例如对应于 102 或 202）、接口映射层 426（例如对应于 126 或 226）、与接口面板 402 耦合的基座部分 404（例如对应于 104 或 204）、将接口面板 402 连接至基座部分 404 的外壳部分 407（例如对应于 107 或 207），以及三个用于扫描接口面板 402 表面的数字摄像头 416。根据具体实施方式的不同，可采用不同数量的数字摄像头 416。
[056] Fig. 4 also depicts components that are internal to the multi-touch input device 400 and that may be present in the multi-touch input devices depicted in Figs. 1 and 2. For example, the exploded view 400 depicts eight light sources (e.g., comprising IR and/or UV LEDs), two of which are depicted at 410 . The light sources (e.g., 410) are optically coupled to an edge of the interface panel 402, such that light is internally reflected inside the interface panel 402. Light from the light sources (e.g., 410) can be optically coupled to the edge of the interface panel 402 using light pipes. Depending on implementation details, a different number of light sources (e.g., 410) can be used. [056] 图 4 还展示了多触点输入设备 400 的内部组件，这些组件可能存在于图 1 和图 2 所示的多触点输入设备中。例如，分解视图 400 描绘了八个光源（例如包含红外和/或紫外 LED），其中两个如 410 所示。这些光源（例如 410）通过光学耦合与界面面板 402 的边缘连接，使得光线在界面面板 402 内部发生全反射。来自光源（例如 410）的光线可采用导光管与界面面板 402 边缘实现光学耦合。根据具体实施方案，可采用不同数量的光源（例如 410）。
[057] Fig. 4 illustrates just one example of how the components (including internal components) of the multi-touch input device can be designed and configured. Depending on implementation details, different configurations, selections, and/or arrangements of components can be used. [057] 图 4 仅展示了多触点输入设备（包括内部组件）设计与配置的一种实施方式。根据实际需求，可采用不同的组件配置方案、选型组合及排布方式。
[058] Fig. 5 depicts a schematic side elevation view of an example multi-touch input device 500 in use, depicting scattered IR light from a touch. In Fig. 5, IR light is being directed to an edge of the interface panel 502 via one or more IR LEDs 510. When the interface panel 502 is touched (e.g., by a user’s finger or by another [058] 图 5 展示了示例性多点触控输入设备 500 在使用中的示意侧视图，描绘了来自触点的散射红外光。在图 5 中，红外光通过一个或多个红外 LED 510 被导向界面面板 502 的边缘。当界面面板 502 被触碰时（例如通过用户手指或其他物体）
object), the reflectivity at the surface of the interface panel 502 is altered, causing some of the IR light to “escape” (to be scattered outward) from the point of contact 530. The light that escapes is detected by the digital cameras 516 as a point source of IR light. The digital cameras 516 can capture images (or frames) multiple times per second, recording the presence or absence of any point sources during each capture. The captured images can be analyzed (e.g., to determine touch events, such as using blob detection) and compared to an interface map to determine the corresponding location on the interface map that has been touched. The captured images can also be analyzed to determine other types of touch events, such as a tap, hold (e.g., for repetitive key entry), multiple touches at different locations, movement, etc. 物体）的作用下，界面面板 502 表面的反射率发生变化，导致部分红外光从接触点 530"逃逸"（向外散射）。这些逃逸的光线被数码相机 516 检测为红外点光源。数码相机 516 每秒可多次捕获图像（或帧），记录每次拍摄时是否存在点光源。通过分析捕获的图像（例如使用斑点检测技术判断触摸事件）并与界面映射图比对，可确定被触碰的对应映射位置。图像分析还能识别其他触摸事件类型，如点击、长按（例如用于重复按键输入）、不同位置的多点触控、移动操作等。
[059] For example, each touch location (e.g., as determined by a center point of the touch location) can activate a corresponding key or other function according to the interface map and its key and/or touch zone layout. [059] 例如，每个触控位置（如通过触控位置中心点确定）可根据界面映射图及其按键和/或触控区域布局激活对应按键或其他功能。
Interface Maps界面映射图
[060] A multi-touch input device (e.g., the multi-touch input devices depicted in Figs. 1 and 2) can include an interface map (e.g., 126 or 226). The interface map provides a layout for keys and/or touchpad areas on the interface panel (e.g., 102 or 202) surface. [060] 一种多点触控输入设备（例如图 1 和图 2 所示的多点触控输入设备）可包含界面映射图（如 126 或 226）。该界面映射图提供了界面面板（如 102 或 202）表面上的按键和/或触控板区域布局。
[061] The interface map can be a plastic film that is affixed or adhered (e.g., removably affixed or adhered) to the interface panel (e.g., to the top or bottom surface of the interface panel). In some implementations, the interface map is a polycarbonate film (e.g., a transparent polycarbonate film). In some implementations, the interface map can be removably adhered to the interface panel such that the interface map can be later removed (e.g., and replaced with a different interface map). The interface map can be a transparent or semi-transparent sheet or film (e.g., transparent to at least IR wavelengths). [061] 所述界面映射图可以是固定或粘附（例如可拆卸式固定或粘附）在界面面板（如界面面板顶部或底部表面）的塑料薄膜。在一些实施方式中，界面映射图为聚碳酸酯薄膜（例如透明聚碳酸酯薄膜）。在某些实施方式中，界面映射图可拆卸地粘附于界面面板，以便后续移除（例如更换为不同的界面映射图）。该界面映射图可以是透明或半透明片材/薄膜（例如至少对红外波长透明）。
[062] The interface map provides a layout for touch areas (e.g., keys and/or touchpad zones) on the interface panel. The layout can be a pre-defined layout or a [062] 界面贴膜为界面面板上的触控区域（例如按键和/或触控板区域）提供布局方案。该布局可以是预定义布局或
custom (e.g., user-defined) layout. For example, pre-defined layouts can be provided for standard keyboard keys in a variety of languages. The layout can be printed or imprinted (e.g., using various printing technologies, such as solvent inkjet printing, UV inkjet printing, laser printing, etc.) on the interface map. For example, the layout of a keyboard key can be depicted on the interface map as an outline of the key area and a symbol indicating the function performed by the key (e.g., the symbol “A” for a key that will enter the letter “A” when touched). 自定义（例如用户定义）布局。举例而言，可为多种语言的标准键盘按键提供预定义布局。该布局可通过印刷或压印（例如采用溶剂型喷墨印刷、UV 喷墨印刷、激光印刷等多种印刷工艺）呈现在界面贴膜上。例如，键盘按键的布局可在界面贴膜上表现为按键区域的轮廓线及表示该按键功能的符号（如标有字母"A"的符号，表示触摸该按键将输入字母"A"）。
[063] Figs. 6A and 6B are plan views of example interface maps, 600 and 640. The first example interface map 600 in Fig. 6A is an English language keyboard layout (e.g., a pre-defined layout). The keyboard layout includes letter keys, number keys, function keys, special keys (e.g., control keys, shift keys, etc.), and a number pad 610. The second example interface map 640 is an English language keyboard layout (e.g., a pre-defined layout), which is similar to the first example layout 610 , but includes a touchpad zone 650 instead of the number pad 610. The second example layout 640 also includes keys which can function as mouse buttons, a right mouse button “RMB” and a left mouse button “LMB” 652 , as well as a zoom slider 650 . For example, the second example interface map 650 can perform the functions of both a keyboard and a mouse. [063] 图 6A 和 6B 分别为示例界面映射图 600 和 640 的平面示意图。图 6A 所示的第一示例界面映射图 600 为英文键盘布局（例如预定义布局），该键盘布局包含字母键、数字键、功能键、特殊键（如控制键、切换键等）以及数字小键盘 610。第二示例界面映射图 640 同样为英文键盘布局（例如预定义布局），其与第一示例布局 610 相似，但用触摸板区域 650 替代了数字小键盘 610。第二示例布局 640 还包含可充当鼠标按键的功能键——右键"RMB"与左键"LMB"652，以及缩放滑杆 650。例如，第二示例界面映射图 650 可同时实现键盘与鼠标的双重功能。
[064] The example interface maps 600 and 640 can represent pre-defined layouts. For example, they can be provided as two pre-defined alternative interface maps for a multi-touch input device. The example interface maps 600 and 640 can be a transparent films (e.g., polycarbonate films) on which the keyboard layouts are printed. [064] 示例界面映射图 600 和 640 可表示预定义布局。例如，它们可作为多触点输入设备的两种预定义备选界面映射方案提供。这些示例界面映射图 600 和 640 可以是印有键盘布局的透明薄膜（如聚碳酸酯薄膜）。
[065] Fig. 7 is a plan view of an example interface map 700. The example interface map 700 represents a mouse or touchpad layout (e.g., a pre-defined layout). The mouse/touchpad layout includes a touchpad zone 710 (e.g., for moving a cursor on a computer screen) and eight buttons 720. For example, the eight buttons can include mouse buttons (e.g., a right mouse button “RMB” and a left mouse button “LMB”) and/or buttons that perform other functions (e.g., pre-defined or user-assignable functions). [065] 图 7 为示例界面映射图 700 的平面示意图。该示例界面映射图 700 展示了鼠标或触控板的预定义布局结构，包含触控区域 710（用于控制计算机屏幕上的光标移动）及八个功能按键 720。其中，八个按键可包含标准鼠标按键（如右键"RMB"和左键"LMB"），以及执行其他功能（如预定义或用户可自定义功能）的辅助按键。
[066] The layout of the interface map can be defined using layout information. The layout information (e.g., size and location of keys and touchpad zones) can be used when creating the interface map (e.g., by printing a layout on plastic film, according to the layout information, to create the interface map) and when processing touches to determine actions to perform (e.g., key presses or touchpad movement). For example, the layout information for keyboard keys can include size (e.g., height and width), shape (e.g., square, round, etc.), and/or function information (e.g., a key, symbol, or function corresponding to the key). Touchpad zone layout information can include size (e.g., height and width), shape (e.g., square, round, etc.), and/or function information (e.g., an indication of how touch information is to be processed, such as a 1 -dimension slider or a 2 -dimension area). For example, the layout information can comprise configuration of the touchpad area (e.g., size, shape, and/or type), location of the touch area on the interface map, and the function performed by the touch area when used. [066] 界面映射的布局可通过布局信息进行定义。该布局信息（例如按键和触控板区域的大小与位置）可用于创建界面映射时（例如根据布局信息在塑料薄膜上印刷布局以生成界面映射）以及处理触控操作以确定待执行动作时（例如按键按压或触控板移动）。举例而言，键盘按键的布局信息可包含尺寸（如高度和宽度）、形状（如方形、圆形等）和/或功能信息（如按键对应的键位、符号或功能）。触控板区域布局信息则可包含尺寸（如高度和宽度）、形状（如方形、圆形等）和/或功能信息（如触控信息处理方式的指示，例如一维滑动条或二维区域）。例如，布局信息可包括触控板区域的配置（如尺寸、形状和/或类型）、触控区域在界面映射上的位置，以及该触控区域在使用时执行的功能。
[067] Table 1 below depicts a simplified example of layout information for a number of keys and a touchpad area (touchpad zone). The “type” column indicates whether the element is a key or touchpad area, the “height x width” column indicates the height and width of the key or touchpad area, the “location” column indicates an x/y offset from the upper-left corner of the interface map where the key or touchpad area is located, and the “key/function” column indicates how touches within the key or touchpad area are processed. [067] 下表 1 展示了一个简化示例，呈现了若干按键及触控板区域（触控板分区）的布局信息。"类型"列标注元素属于按键还是触控板区域，"高度×宽度"列标明按键或触控板区域的尺寸规格，"位置"列记录按键或触控板区域相对于界面映射图左上角的 x/y 偏移坐标，而"按键/功能"列则说明在该按键或触控板区域内触控操作的响应机制。
Table 1: Table 1 - Example Layout Information 表 1：示例布局信息
[068] The interface map can be a pre-defined interface map. For example, a multitouch input device can be provided with a standard pre-defined interface map (e.g., a standard English-language keyboard interface map), or multiple standard predefined interface maps can be provided from which a selection can be made. For example, a purchaser of a multi-touch input device may be provided with the option of a standard keyboard layout interface map with a number pad or a standard keyboard layout interface map with a touchpad in place of the number pad. One or more standard pre-defined interface maps can be provided with an input device (e.g., pre-attached to the input device or user-attached), or purchased separately. [068] 该界面映射可以是预定义的界面映射。例如，可为多点触控输入设备配备标准的预定义界面映射（如标准英文键盘界面映射），也可提供多种标准预定义界面映射供用户选择。举例而言，多点触控输入设备的购买者可以选择带数字小键盘的标准键盘布局界面映射，或选择用触摸板替代数字小键盘的标准键盘布局界面映射。预定义的标准界面映射可随输入设备一并提供（如预先附着于输入设备或由用户自行安装），亦可单独购买。
[069] The interface map can be a custom or user-defined interface map. For example, a custom interface map can be defined (e.g., by a user) using pre-defined elements and/or by defining the layout using individual or custom elements. Predefined elements can include blocks of keys (e.g., a block of letters, numbers, and associated space bar, control key etc., a block of arrow keys, a block of function keys, a block of keys for a number pad, etc.) or pre-defined touchpad areas (e.g., a touchpad zone of a pre-determined size for use as a cursor movement or mouse area). Defining the layout using individual or custom elements can include selecting individual elements (e.g., specific keys, such as letters, numbers, function keys, arrow keys, etc., including location and/or size) and/or defining custom elements (e.g., defining the custom element by size, shape, function, etc.). For example, a custom element can be a key of a specific size, shape, and location that performs a simple or complex function (e.g., a key that types a sequence of letters or that performs one or more actions). [069] 界面映射可以是自定义或用户定义的界面映射。例如，可通过预定义元素和/或使用独立/自定义元素定义布局来创建（如由用户）自定义界面映射。预定义元素可包括按键区块（例如字母区、数字区及关联空格键与控制键组成的区块、方向键区块、功能键区块、数字小键盘区块等）或预定义触控板区域（例如用于光标移动或鼠标操作的固定尺寸触控板分区）。使用独立/自定义元素定义布局可包括选择独立元素（如特定按键，包括字母、数字、功能键、方向键等及其位置/尺寸）和/或定义自定义元素（如通过尺寸、形状、功能等定义）。例如，自定义元素可以是一个具有特定尺寸、形状和位置的按键，用于执行简单或复杂功能（如输入字母序列或执行一个/多个操作的按键）。
[070] Interface maps can be created using a web site. For example, a user can create a custom interface map using a web site (e.g., using a graphical user interface to create the layout of the interface map). The user can then order or purchase the custom interface map. The custom interface map can be printed and delivered to the user. The user can then attach the custom interface map to a multi-touch input device. The user can also receive a configuration or data file (e.g., a firmware file) comprising layout information for the custom interface map (e.g., as a downloaded [070] 可通过网站创建界面映射图。例如，用户可利用网站创建自定义界面映射图（如通过图形用户界面设计映射图布局），随后可订购或购买该定制映射图。定制映射图可经印刷后交付用户，用户可将其附着于多点触控输入设备上。用户还可接收包含定制界面映射图布局信息的配置文件或数据文件（例如作为可下载的固件文件）。
file or on a storage device received with the interface map). The user can install (e.g., via a firmware update) the configuration or data file on the multi-touch input device (e.g., via a USB or wireless connection from the user’s computer), thus configuring the multi-touch input device to process touch events according to the custom interface map created by the user. In addition to a configuration file, a custom driver can be provided allowing a computing device (e.g., a computer) to process events from the input device (e.g., events for custom functions, other than standard key and mouse events). 文件或通过接口映射接收的存储设备上的文件）。用户可以在多点触控输入设备上安装（例如通过固件更新）该配置文件或数据文件（例如通过用户计算机的 USB 或无线连接），从而将多点触控输入设备配置为按照用户创建的自定义接口映射处理触摸事件。除配置文件外，还可提供自定义驱动程序，使计算设备（如计算机）能够处理来自输入设备的事件（例如自定义功能事件，而非标准按键和鼠标事件）。
[071] Interface maps can also be created locally by a user. For example, a user can create a custom interface map using software on the user’s computer (e.g., a custom interface map design application). The user can then order or purchase the custom interface map (e.g., by uploading or sending the custom interface map to the manufacturer or to a third party), or the user can locally print the custom interface map. For example, the user can use a variety of printers (e.g., UV printers, inkjet printers, and solvent printers) to print the custom interface map on a sheet or film (e.g., on a polycarbonate film) and attach the custom interface map to a multi-touch input device. The user can also generate (e.g., via the software on the user’s computer) a configuration or data file (e.g., a firmware file) comprising layout information for the custom interface map. The user can install (e.g., via a firmware update) the configuration or data file on the multi-touch input device (e.g., via a USB or wireless connection from the user’s computer), thus configuring the multitouch input device to process touch events according to the custom interface map created by the user (e.g., by detecting one or more touches by a finger or other object and mapping the location(s), according to the custom interface map, to generate key press and/or touchpad movement events and communicate the events to an attached computing device). In addition to a configuration file, a custom driver can be provided allowing a computing device (e.g., a computer) to process events from the input device (e.g., events for custom functions, other than standard key and mouse events). [071] 用户也可在本地创建界面映射图。例如，用户可通过计算机上的软件（如自定义界面映射设计应用程序）创建个性化界面映射图。随后用户可订购或购买该定制映射图（例如通过将文件上传或发送给制造商或第三方），也可选择本地打印该定制映射图。用户可采用多种打印机（如 UV 打印机、喷墨打印机和溶剂型打印机）在片材或薄膜（如聚碳酸酯薄膜）上打印定制界面映射图，并将其附着于多点触控输入设备。用户还能通过计算机软件生成包含定制界面映射图布局信息的配置文件或数据文件（如固件文件）。 用户可通过固件更新等方式（例如从计算机通过 USB 或无线连接）在多点触控输入设备上安装配置文件或数据文件，从而将该设备配置为按照用户创建的自定义界面映射来处理触摸事件（例如通过检测手指或其他物体的一次或多次触摸，并根据自定义界面映射定位来生成按键按压和/或触控板移动事件，再将事件传输至连接的计算机设备）。除配置文件外，还可提供定制驱动程序，使计算设备（如计算机）能够处理来自输入设备的事件（如标准按键和鼠标事件之外的自定义功能事件）。
[072] The interface maps can be attached to the input device at a specific location. For example, indicators (e.g., raised bumps, imprinted marks, etched marks, etc.) can be present on the input device interface panel for determining where to attach the interface map. The indicators can be located, for example, at or near one or more corners of the input device interface panel corresponding to one or more corners of the interface map. [072] 界面贴图可附着于输入设备的特定位置。例如，输入设备接口面板上可设置定位标识（如凸点、压印标记、蚀刻标记等），用于确定界面贴图的附着位置。这些定位标识可设置于输入设备接口面板的一个或多个边角处，与界面贴图的对应边角相吻合。
[073] The interface map can be a transparent or semi-transparent film (e.g., a transparent or semi-transparent polycarbonate film). The interface map can also be colored (e.g., a transparent film with a colored tint), such as with colors that fluoresce under UV light. The layout that is printed on the interface map can also be printed in a variety of colors, including colors that fluoresce under UV light. The layout that is printed on the interface map can be printed in an outline format showing the outline of keys and/or touchpad zones, in addition to symbols indicating the function or action performed by the key and/or touchpad zone (e.g., a letter, such as “S,” indicating that the key will type the letter “S” when touched). [073] 界面贴图可采用透明或半透明薄膜材质（如聚碳酸酯薄膜）。该贴图亦可着色处理（例如带有色泽的透明薄膜），包括在紫外光下会发出荧光的颜色。印刷在界面贴图上的布局图案可采用多种色彩呈现，同样包含紫外荧光色。布局图案可采用轮廓线形式呈现按键和/或触控区域的外形轮廓，并辅以符号标明该按键和/或触控区域的功能（例如字母"S"表示触碰该按键可输入字母"S"）。
[074] The interface map can be attached or applied (e.g., removably attached or applied) to the top or bottom surface of the interface panel. For example, the interface map can be a polycarbonate film coated with a transparent adhesive (e.g., a “static film”) allowing the interface map to be attached, and later removed if needed (e.g., to replace the interface map with a new interface map having the same layout or a different layout). [074] 界面贴图可附着或贴合（例如可拆卸式附着或贴合）于界面面板的顶面或底面。例如，该界面贴图可以是涂覆透明粘合剂（如"静电膜"）的聚碳酸酯薄膜，使其既能牢固粘贴，又可在需要时轻松移除（例如更换为具有相同或不同布局的新界面贴图）。
[075] In some implementations the interface map can be permanently attached to the top or bottom surface of the interface panel. In yet other implementations, instead of being a separate film or sheet, the interface map can be integrated with the interface panel (e.g., printed directly on the surface of the interface panel or etched into the interface panel). [075] 在某些实施方案中，界面贴图可永久固定于界面面板的顶面或底面。另一些实施方案中，界面贴图无需采用独立薄膜或片材形式，而是可与界面面板集成（例如直接印刷在面板表面或蚀刻于面板内部）。
[076] In some implementations, the interface map may be changed by a user, and a corresponding configuration file provided to load a new interface map. For example, an interface map comprising a standard QWERTY keyboard printed on a static film [076] 在某些实施方案中，用户可自行更换界面贴图，并通过加载相应配置文件启用新贴图。例如，当采用印有标准 QWERTY 键盘的静电膜作为界面贴图时
may be applied to an interface panel with a corresponding configuration file, allowing the input device to be used as a Western-alphabet keyboard. The user could then remove and replace the interface map with a different interface map having a Chinese-character keyboard layout, load the corresponding configuration file (e.g., as a firmware update to the input device), and use the input device as a Chinese character keyboard. The user could also create her own customized interface map and configuration file, for a desired specific functionality, print the interface map on static film, and apply it to the interface panel. The interface panel may be made from extremely rugged materials, such as tempered glass, GORILLA GLASS ^(TM){ }^{\mathrm{TM}}, acrylic, or other materials which can easily transmit IR wavelengths. 可应用于带有相应配置文件的接口面板，使输入设备能够作为西文字母键盘使用。用户随后可以取下并更换为具有中文字符键盘布局的不同接口贴膜，加载对应的配置文件（例如作为输入设备的固件更新），即可将输入设备用作中文键盘。用户还可以根据特定功能需求，创建自定义的接口贴膜和配置文件，将接口贴膜打印在静电薄膜上并贴附至接口面板。该接口面板可采用极其坚固的材料制成，如钢化玻璃、GORILLA GLASS ^(TM){ }^{\mathrm{TM}} 、亚克力或其他能轻松透射红外波长的材料。
Methods for Creating Interface Maps 创建接口贴膜的方法
[077] FIG. 8 is a flowchart of an exemplary method 800 for creating a custom interface map for a frustrated total internal reflection (FTIR) multi-touch input device. At 810, layout information is received for a custom interface map. The layout information defines a plurality of touch areas. For example, the touch areas can be keys and/or touchpad zones. The layout information can be received from a user using a local software application or from a user using a remote service (e.g., via a web site). [077] 图 8 是为受抑全内反射(FTIR)多点触控输入设备创建自定义界面映射的示例性方法 800 流程图。在步骤 810 中，接收自定义界面映射的布局信息。该布局信息定义了多个触控区域，例如可以是按键和/或触控板分区。布局信息可通过本地软件应用从用户处获取，或通过远程服务（如网站）从用户处接收。
[078] At 820, a layout is generated for the custom interface map according to the received layout information 810 . For example, the layout can depict outlines and/or symbols for the various touch areas (e.g., keys and touchpad zones) defined by the layout information. [078] 在步骤 820 中，根据接收到的布局信息 810 生成自定义界面映射的布局。例如，该布局可呈现由布局信息定义的各种触控区域（如按键和触控板分区）的轮廓和/或符号。
[079] At 830, a configuration file is generated from the received layout information 810. The configuration file is loadable on the FTIR multi-touch input device to configure the FTIR multi-touch input device to use the custom interface map. In addition, a custom driver can be created to support input device functions (e.g., functions that use custom processing) on an associated computing device. [079] 在步骤 830 中，根据接收到的布局信息 810 生成配置文件。该配置文件可加载至 FTIR 多点触控输入设备，用于配置设备以使用自定义界面映射。此外，还可创建定制驱动程序以支持关联计算设备上的输入设备功能（例如采用定制处理的功能）。
[080] At 840, the configuration file is output. For example, the configuration file can be stored on a server computer or on a local computer. The configuration file can be delivered (e.g., separately or with the custom interface map) to a user to install on the multi-touch input device (e.g., via a USB or wireless firmware update of the multi-touch input device). In addition, a custom driver can be provided for storage and/or installation. [080] 在步骤 840 中，输出配置文件。例如，该配置文件可存储于服务器计算机或本地计算机上。配置文件可被递送（例如单独或与定制界面贴膜一起）给用户以安装至多点触控输入设备（例如通过 USB 或无线固件更新方式）。此外，还可提供定制驱动程序以供存储和/或安装。
[081] The custom interface map can be created by printing the generated layout 830 on a transparent film. The interface map can be printed, for example, at a manufacturer, third party, or locally by a user. [081] 定制界面贴膜可通过将生成的布局 830 打印在透明薄膜上制作完成。该界面贴膜可由制造商、第三方服务商或用户本地打印产出。
[082] For example, an online web service can provide a design tool for receiving the layout information 810 from a user. The online web service can generate the layout 820 , generate the configuration file 830 , and output the configuration file (e.g., store the configuration file and/or send the configuration file to the user). The online web service can provide the layout for printing on a transparent film (e.g., at a manufacturer of the multi-touch input device or a third party printing service) and delivery to the user. [082] 举例而言，在线网络服务可提供设计工具来接收用户提交的布局信息 810。该在线服务能生成布局 820、生成配置文件 830 并输出配置文件（例如存储配置文件及/或发送至用户）。在线网络服务还可提供用于透明薄膜打印的布局文件（例如由多点触控设备制造商或第三方印刷服务执行）并交付给用户。
[083] A user can also print the custom interface map locally. For example, the user can use local software (e.g., running on the user’s computer) or a remote service to design the custom interface map and print the layout on transparent film using a local printer. The user can also generate or download a corresponding configuration file for the custom interface map and install it on the multi-touch input device along with the transparent film with the printed custom layout (the custom interface map). The user can also generate or download a corresponding custom driver to install on the user’s computing device to support the input device with the custom layout. [083] 用户也可在本地打印定制界面图。例如，用户可使用本地软件（如运行于用户计算机上的程序）或远程服务来设计定制界面图，并通过本地打印机将布局打印在透明胶片上。用户还可生成或下载与定制界面图对应的配置文件，将其与印有定制布局（即定制界面图）的透明胶片一同安装在多点触控输入设备上。此外，用户也能生成或下载相应的定制驱动程序，安装于计算设备中以支持带有定制布局的输入设备。
UV Sterilization紫外线杀菌
[084] Sterilization technology can be used with any of the multi-touch input devices described herein. For example, specific wavelengths of UV light can be used to sterilize the surface of the multi-touch input device (e.g., to sterilize the interface [084] 本文所述的多点触控输入设备均可采用灭菌技术。例如，可使用特定波长的紫外线对多点触控输入设备表面进行灭菌处理（如对操作界面进行灭菌）
panel, including the interface map, of the multi-touch input device). In some implementations, the ultraviolet light is emitted at wavelengths of approximately 265 nm to 280 nm . 面板（包括多点触控输入设备的界面映射图）。在某些实施方案中，紫外线发射波长约为 265 纳米至 280 纳米。
[085] In some implementations, sterilization is performed using UV light. UV light can be applied to the interface panel of a multi-touch input device. For example, UV LEDs can be used to direct UV light into the edge of the interface panel. The UV light can provide a sterilization effect to the multi-touch input device from inside the interface panel. Alternatively, UV light can be directed to the outside (e.g., top or bottom) surface of the interface panel (e.g., separately or in combination with internally-directed UV light). [085] 在某些实施方案中，采用紫外线进行消毒处理。紫外线可照射至多点触控输入设备的界面面板。例如，可利用紫外 LED 将紫外线导向界面面板边缘。该紫外线可从界面面板内部对多点触控输入设备产生消毒效果。或者，也可将紫外线导向界面面板的外表面（例如顶部或底部），既可单独实施也可与内部照射的紫外线组合使用。
[086] In an example implementation, the light source (e.g., of multi-touch input devices depicted in Figs. 1 through 5) can comprise UV LEDs (e.g., in addition to IR LEDs). The UV LEDs can be enabled when a UV sterilization effect is desired. For example, the UV LEDs can be enabled at pre-defined times (e.g., on a schedule) or at user-defined times (e.g., on a user-defined schedule or manually enabled). The UV LEDs can be enabled for a specific duration sufficient to provide a sterilization effect to the multi-touch input device (e.g., a number of seconds or minutes, such as 2-3 minutes). [086] 在示例实施方案中，（如图 1 至 5 所示的多点触控输入设备的）光源可包含紫外 LED（例如与红外 LED 共同配置）。当需要紫外线消毒时，可启动紫外 LED。例如，紫外 LED 可按预设时间（如定时计划）或用户自定义时间（如用户设定计划或手动）启动。紫外 LED 会持续开启特定时长，以确保对多点触控输入设备产生充分消毒效果（例如数秒或数分钟，如 2-3 分钟）。
[087] The UV LEDs can be enabled during a cleaning cycle of the multi-touch input device. For example, the cleaning cycle can be enabled according to a schedule (e.g., once a day when the input device is not in use, such as during the night). The cleaning cycle can be enabled when the input device is in a sleep mode (e.g., when the input device has not been used for an amount of time, such as a number of minutes or hours and/or when a computing device connected to the input device has not been used for an amount of time). The cleaning cycle can be enabled during a period of inactivity according to an inactivity timer (e.g., when the input device has been inactive for a number of minutes or hours). [087] 紫外线 LED 可在多点触控输入设备的清洁周期中启用。例如，可根据预定计划启动清洁周期（如每天在输入设备未使用时进行一次，例如夜间）。当输入设备处于睡眠模式时也可启动清洁周期（例如当输入设备闲置达到一定时长——若干分钟或小时，和/或当连接至输入设备的计算设备未使用达到一定时长时）。根据闲置计时器，在非活动期间亦可启动清洁周期（如当输入设备持续未活动达数分钟或数小时时）。
[088] The interface panel of the multi-touch input device can be made from a material (e.g., specific types of glass or glass blend) that does not attenuate (or does not significantly attenuate) the specific UV wavelengths used. [088] 多点触控输入设备的界面面板可采用特定材料（如特殊类型玻璃或混合玻璃）制成，该材料不会衰减（或不会显著衰减）所使用的特定紫外线波长。
[089] The UV cleaning cycle can be user-initiated. For example, a user can manually initiate a UV cleaning (e.g., a 2-3 minute UV cleaning cycle). [089] 紫外线清洁周期可由用户主动触发。例如，用户可手动启动紫外线清洁程序（如持续 2-3 分钟的紫外线清洁周期）。
Removing Infrared Interference 消除红外干扰
[090] Infrared interference can be removed from digital images captured using any of the multi-touch input devices described herein. For example, a first digital image can be captured with an infrared light source of a multi-touch input device turned off, and a second digital image can be captured with the infrared light source turned on. Because the first digital image is captured with the infrared light source turned off, any infrared light detected in the first digital image will be the result of an infrared light source other than the infrared light source of the multi-touch input device. Such infrared interference present in the first digital image can be removed from the second digital image. For example, various image processing techniques can be applied to filter out or remove (e.g., subtract) the infrared interference during image processing (e.g., to produce a processed image with the infrared interference removed). [090] 从采用本文所述任一多触点输入设备采集的数字图像中均可消除红外干扰。例如，可先关闭多触点输入设备的红外光源采集第一幅数字图像，再开启红外光源采集第二幅数字图像。由于第一幅图像是在红外光源关闭状态下采集的，其中检测到的任何红外光均来自多触点输入设备之外的红外光源。通过图像处理技术（如进行图像减法运算），可将第一幅图像中存在的此类红外干扰从第二幅图像中滤除或移除（例如生成消除红外干扰后的处理图像）。
[091] There can be many sources of infrared interference in everyday environments. Infrared interference can interfere with the proper determination of touch events on a FTIR multi-touch input device. For example, an external infrared light source, such as an IR remote control, can be detected by the digital camera of the input device. Depending on the size, shape, and/or duration of the detected IR remote control light source, the input device could determine that a touch event has occurred, and activate a corresponding keyboard key for example. [091] 日常环境中存在多种红外干扰源。红外干扰会影响 FTIR 多点触控输入设备对触摸事件的准确判定。例如，外部红外光源（如红外遥控器）可能被输入设备的数码相机检测到。根据检测到的红外遥控光源的尺寸、形状和/或持续时间，输入设备可能误判为发生了触摸事件，从而触发相应键盘按键的响应。
[092] Figs. 9A, 9B, and 9C are diagrams depicting example digital images, from which infrared interference can be detected and removed. The first digital image 900 in Fig. 9A represents a digital image that is captured by a digital camera of a multi- [092] 图 9A、9B 和 9C 展示了可检测并消除红外干扰的示例数字图像。图 9A 中的第一幅数字图像 900 表示由多点触控设备数码相机捕捉的数字图像，
touch input device when an infrared light source of the multi-touch input device is turned off. Because the infrared light source of the input device is turned off, any detected infrared light will be from a source other than the infrared light source of the input device. In addition, even if an interface panel of the input device is being touched (e.g., by a person’s finger), the touch location will not be detected because the infrared light source of the input device is off. 当多点触控输入设备的红外光源关闭时。由于输入设备的红外光源处于关闭状态，任何检测到的红外光都将来自输入设备红外光源之外的其他来源。此外，即使输入设备的界面面板被触摸（例如被手指触碰），由于设备红外光源处于关闭状态，触摸位置也不会被检测到。
[093] The first digital image 900 depicts two locations where infrared light is detected, 902 and 904. The two locations of infrared light, 902 and 904, detected when the infrared light source is turned off are two locations of infrared interference. For example, the infrared interference could be generated by an IR remote control. The two locations of infrared light, 902 and 904, are considered to be infrared interference because they could be incorrectly interpreted as touch events. [093] 第一张数字图像 900 显示了两个检测到红外光的位置 902 和 904。当红外光源关闭时检测到的这两个红外光位置 902 和 904，属于两处红外干扰源。例如，这类红外干扰可能由红外遥控器产生。这两个红外光位置 902 和 904 被视为干扰信号，因为它们可能被误判为触控事件。
[094] The second digital image 920 in Fig. 9 B represents a digital image that is captured by a digital camera of a multi-touch input device when an infrared light source of the multi-touch input device is turned on. Because the infrared light source of the input device is turned on, infrared light will be detected from touch events (e.g., scattered infrared light from a person touching an interface panel of the input device) as well as any from any other infrared light source. Therefore, the second digital image 920 will depict actual touch events in addition to any infrared interference. [094] 图 9B 中的第二数字图像 920 表示当多触点输入设备的红外光源开启时，由该设备的数码相机捕获的数字图像。由于输入设备的红外光源处于开启状态，系统将检测到来自触摸事件（例如人体接触输入设备界面面板时散射的红外光）以及来自其他红外光源的干扰信号。因此，第二数字图像 920 除了会显示真实触摸事件外，还会呈现红外干扰信号。
[095] The second digital image 920 depicts three locations where infrared light is detected, 922, 924, and 926. The two locations of infrared light, 922 and 924, correspond to the two locations of infrared light, 902 and 904, detected in image 900. An additional location of infrared light 926 is also depicted in the second digital image 920. [095] 第二数字图像 920 显示了三个红外光检测位置 922、924 和 926。其中两个红外光位置 922 和 924，与图像 900 中检测到的两个红外光位置 902 和 904 相对应。第二数字图像 920 中还呈现了一个额外的红外光位置 926。
[096] The third digital image 940 in Fig. 9C represents a digital image that can be generated using the first digital image 900 and the second digital image 920. The third digital image 940 depicts detected infrared light with infrared interference removed. Specifically, the third digital image 940 depicts one location of detected [096] 图 9C 中的第三数字图像 940 展示了利用第一数字图像 900 与第二数字图像 920 生成的数字图像。该第三数字图像 940 呈现了去除红外干扰后的红外光检测结果，具体展示了被检测到的某一位置
infrared light 946, which can be determined to be a touch event (e.g., a valid touch event). For example, the third digital image 940 can be a new digital image that is created by taking the second digital image 920 and subtracting the first digital image 900 . The third digital image 940 can also represent a modified version of the second digital image 920 (e.g., modified by removing the locations of detected infrared light present in the first digital image 900 from the second digital image 920). 红外光 946，可判定为触摸事件（例如有效触摸事件）。举例而言，第三数字图像 940 可以是通过获取第二数字图像 920 并减去第一数字图像 900 而生成的新数字图像。第三数字图像 940 也可表示第二数字图像 920 的修改版本（例如通过从第二数字图像 920 中移除第一数字图像 900 中检测到的红外光位置而修改的版本）。
[097] In a first example image processing technique, the second digital image modified to filter out (e.g., subtract) the infrared interference from the first digital image. The result of the first image processing technique is a modified second digital image. [097] 在第一种示例性图像处理技术中，对第二数字图像进行修改以滤除（例如减去）来自第一数字图像的红外干扰。第一种图像处理技术的结果是生成修改后的第二数字图像。
[098] In a second example image processing technique, a new digital image is created by subtracting the first digital image from the second digital image. The result of the second image processing technique is the new digital image, which depicts detected infrared light present in the second digital image, but not the first digital image. [098] 在第二种示例性图像处理技术中，通过将第二幅数字图像减去第一幅数字图像来创建新的数字图像。该技术的处理结果是生成的新数字图像，其呈现了第二幅数字图像中存在而第一幅数字图像中未检测到的红外光。
[099] In a third example image processing technique, locations of detected infrared light are determined from the first digital image and from the second digital image. For example, the locations can be determined based on size, shape, position, and/or intensity. Specific locations of detected infrared light that are present in both the first and second digital image can then be removed (e.g., they can be discarded from consideration as valid touch events). The result of the third image processing technique are any specific locations of detected infrared light that are present in the second digital image and that do not have any corresponding locations in the first digital image (e.g., corresponding locations 902 and 922, and 904 and 924, can be removed leaving location 926 as a valid touch event). [099] 在第三种示例性图像处理技术中，首先从第一幅和第二幅数字图像中确定检测到的红外光位置。例如，可根据尺寸、形状、位置和/或强度来判定位置。随后可移除那些在第一幅和第二幅数字图像中同时存在的特定红外光检测位置（例如，这些位置可被排除在有效触摸事件判定范围之外）。该技术的处理结果是：保留第二幅数字图像中存在且在第一幅数字图像中没有对应位置的所有特定红外光检测位置（例如，可移除 902 与 922、904 与 924 等对应位置，最终将 926 位置判定为有效触摸事件）。
[0100] In order to detect infrared interference, some digital images can be captured by an FTIR multi-touch input device when the infrared light source (e.g., one or more IR LEDs) of the FTIR multi-touch input device is on, and other digital images can be captured when the infrared light source is off. For example, digital images [0100] 为检测红外干扰，FTIR 多点触控输入设备可在其红外光源（如一个或多个红外 LED）开启时拍摄若干数字图像，并在光源关闭时拍摄其他数字图像。例如，可以
can be captured at a first rate (e.g., a predetermined number of images per second) and the infrared light source can be configured to flicker at a second rate. By setting the first rate to be greater than the second rate, some of the digital images will be captured when the infrared light source is off. The digital images that are captured when the infrared light source is off can show infrared interference and can be used to process digital images taken when the infrared light source is on to remove the infrared interference. 以第一速率（如每秒预定帧数）拍摄数字图像，同时将红外光源配置为以第二速率闪烁。通过将第一速率设置为高于第二速率，部分数字图像将在红外光源关闭时被捕获。这些在光源关闭状态下拍摄的数字图像可显示红外干扰，并用于处理光源开启时拍摄的数字图像以消除红外干扰。
[0101] In some implementations, the infrared light source is configured to switch between on and off between each successive digital image. For example, a first digital image can be captured with the IR light source on, the next digital image can be captured with the IR light source off, the next digital image can be captured with the IR light source on, and so on. For example, if the rate of digital image capture is 30 images per second, then the cycling rate of the IR light source can be set to 15 cycles per second, such that every other image is captured with the IR light source on. Alternatively, other rates of capture and IR cycling can be used (e.g., image capture at 50 images per second with IR light cycling at 25 cycles per second). Similarly, other ratios of images captured with and without the IR light source can be used. For example, every third or every fourth digital image can be captured with the IR light source turned off. [0101] 在某些实施方案中，红外光源被配置为在每幅连续数字图像之间进行开关切换。例如，第一幅数字图像可在红外光源开启状态下拍摄，下一幅数字图像可在红外光源关闭状态下拍摄，随后一幅数字图像再次在红外光源开启状态下拍摄，以此类推。举例说明，若数字图像拍摄速率为每秒 30 帧，则可将红外光源的切换频率设定为每秒 15 次，使得每隔一帧图像在红外光源开启状态下拍摄。当然，也可采用其他拍摄速率与红外切换频率的组合（例如以每秒 50 帧拍摄图像，同时红外光源以每秒 25 次的频率切换）。同理，亦可采用其他红外光源开启与关闭状态下的图像拍摄比例。例如，可设定每三幅或每四幅数字图像中有一幅在红外光源关闭状态下拍摄。
[0102] Fig. 10 depicts an example method 1000 for removing infrared interference. At 1010, a first digital image is captured with an infrared light source turned off. At 1020, a second digital image is captured with the infrared light source turned on. The second digital image can be the next image captured after the first digital image. The first and second digital images can be captured by a digital camera of a FTIR multi-touch input device. The infrared light source can be configured to emit infrared light within an interface panel of the FTIR multi-touch input device. [0102] 图 10 展示了一种消除红外干扰的示例方法 1000。在步骤 1010 中，关闭红外光源拍摄第一张数字图像。在步骤 1020 中，开启红外光源拍摄第二张数字图像。该第二张数字图像可以是紧接第一张之后拍摄的图像。这两张数字图像可由 FTIR 多点触控输入设备的数码相机拍摄。所述红外光源可配置为在 FTIR 多点触控输入设备的界面面板内发射红外光。
[0103] At 1030, the first and second digital images can be processed to remove infrared interference. For example, infrared interference from the first captured digital image 1010 can be subtracted from the second captured digital image 1020. In some implementations, the second digital image is filtered, based at least in part [0103] 在 1030 步骤中，可对第一和第二数字图像进行处理以消除红外干扰。例如，可从第二捕获数字图像 1020 中减去第一捕获数字图像 1010 的红外干扰。在某些实施方案中，第二数字图像的滤波处理至少部分基于
upon the first digital image, to subtract infrared interference present in the first digital image from the second digital image. 在第一张数字图像上，从第二张数字图像中减去第一张数字图像中存在的红外干扰。
[0104] In some implementations, the first digital image is analyzed to determine whether infrared interference is present (e.g., wither the size, shape, content, and/or position of infrared light is sufficient to be capable of interfering with the detection of touch events). When infrared interference is present (e.g., only when the infrared interference is present), the second digital image can be filtered to remove the infrared interference. Alternatively, a new digital image can be created by removing (e.g., subtracting) the infrared interference present in the first digital image from corresponding infrared interference present in the second digital image. [0104] 在一些实施方式中，会对第一数字图像进行分析以判断是否存在红外干扰（例如，红外光的尺寸、形状、内容及/或位置是否足以对触摸事件检测造成干扰）。当存在红外干扰时（例如，仅在存在红外干扰的情况下），可对第二数字图像进行滤波以消除该红外干扰。或者，也可以通过从第二数字图像中对应的红外干扰中去除（例如减去）第一数字图像中存在的红外干扰，来创建新的数字图像。
[0105] In some implementations, infrared interference is detected in digital images captured when the infrared light source is off. Compensation for the infrared interference is then performed for digital images captured when the infrared light source is on. For example, the digital images captured when the infrared light source is on can be filtered to remove the infrared interference, filtering can be performed when (e.g., only when) infrared interference is present is a corresponding digital images captured when the infrared light source is off, and/or processed digital images can be generated by subtracting the infrared interference. [0105] 在某些实施方案中，当红外光源关闭时捕获的数字图像中可检测到红外干扰。随后对红外光源开启时捕获的数字图像进行红外干扰补偿。例如，可通过滤波去除红外光源开启时捕获数字图像中的红外干扰（该滤波处理可仅在关闭红外光源时捕获的对应数字图像中存在红外干扰时执行），和/或通过减去红外干扰分量生成处理后的数字图像。
Removing Contamination from Digital Images 消除数字图像中的污染
[0106] Contamination can be removed from digital images captured using any of the multi-touch input devices described herein. For example, a digital image can be captured with an infrared light source of a multi-touch input device turned on and when an interface panel of the multi-touch input device is not being touched. The digital image can be captured, for example, when the input device is turned on (e.g., as part of an initialization or wake-up process). [0106] 使用本文所述任何多点触控输入设备捕获的数字图像均可进行污染消除。例如，可在多点触控输入设备的红外光源开启且界面面板未被触摸时捕获数字图像。该图像捕获操作可在设备启动时执行（例如作为初始化或唤醒流程的一部分）。
[0107] The digital image can be processed to determine whether any contamination is present. For example, any infrared light detected in the digital image can be treated as contamination. Alternatively, the digital image can be compared to a [0107] 可对数字图像进行处理以判断是否存在污染。例如，检测到数字图像中的任何红外光均可视为污染。或者，可将数字图像与
reference image (e.g., a digital image captured when the input device was manufactured or during a setup process) and any difference can be treated as contamination. Contamination information can be determined from the digital image (e.g., information indicating size, shape, intensity, and/or position of infrared light corresponding to instances of contamination). One or more subsequent images can then be filtered to remove detected infrared light resulting from the contamination (e.g., to subtract instances of contamination, using the contamination information, from the subsequent images). 参考图像（例如，在输入设备制造时或设置过程中捕获的数字图像），任何差异均可视为污染物。可从该数字图像中确定污染物信息（例如，指示污染物对应红外光的大小、形状、强度及/或位置的信息）。随后可对一幅或多幅后续图像进行过滤，以消除由污染物导致的红外光（例如，利用污染物信息从后续图像中减去污染物对应的红外光）。
[0108] In another implementation, a first digital image can be captured with an infrared light source of a multi-touch input device turned on and when an interface panel of the multi-touch input device is not being touched. The first image can represent a “default” or “reference” image (e.g., an image captured when the device is manufactured, first activated, or at a later time such as during a setup process). A second digital image can be captured at a later time with an infrared light source of a multi-touch input device turned on and when the interface panel of the multi-touch input device is not being touched. The second digital image can be captured, for example, when the input device is turned on or during an automatic or user-initiated contamination detection operation. The first and second digital images can be processed to determine whether any contamination is present in the second digital image in comparison to the first digital image. For example, contamination information (e.g., a contamination mask) can be determined that indicates the size, shape, intensity, and/or position of infrared light created by the contamination. One or more subsequent images can then be filtered, using the contamination information, to remove detected infrared light corresponding to the contamination. [0108] 在另一种实施方式中，可在开启多点触控输入设备的红外光源且未触碰其界面面板时拍摄第一幅数字图像。该第一幅图像可视为"默认"或"基准"图像（例如设备出厂时、首次激活时或在后续设置过程中拍摄的图像）。随后可在开启红外光源且未触碰界面面板时拍摄第二幅数字图像，例如在输入设备启动时或执行自动/用户触发的污染检测操作期间进行拍摄。通过对比处理这两幅数字图像，可判断第二幅图像是否存在污染。例如可生成污染信息（如污染掩模），用于标示污染物产生的红外光尺寸、形状、强度及/或位置信息。 随后可利用污染信息对一个或多个后续图像进行过滤，以去除与污染物相对应的检测到的红外光。
[0109] There can be many sources of contamination in everyday environments. For example, contamination (e.g., dust, dirt, grease, food crumbs, coffee, and other types of debris) can interfere with the proper determination of touch events on an FTIR multi-touch input device. For example, such debris can scatter infrared light being reflected within the interface panel of the input device and be detected by the digital cameras. The detected infrared light from such contamination may be difficult to [0109] 在日常环境中可能存在多种污染源。例如，污染物（如灰尘、污垢、油脂、食物碎屑、咖啡渍及其他类型的碎屑）会干扰 FTIR 多点触控输入设备对触摸事件的正确判定。这类碎屑会散射在输入设备界面面板内反射的红外光，并被数码相机检测到。来自此类污染物的检测红外光可能难以
distinguish from touch events. For example, depending on the size, shape, and/or duration of the detected infrared light from the contamination, the input device could determine that a touch event has occurred, and activate a corresponding keyboard key. 与触摸事件区分。例如，根据污染物产生的红外光在尺寸、形状和/或持续时间上的特征，输入设备可能误判为发生了触摸事件，从而触发对应的键盘按键。
[0110] Figs. 11A, 11B, and 11C are diagrams depicting example digital images, from which infrared contamination can be detected and removed. The first digital image 1100 in Fig. 11A represents a digital image that is captured by a digital camera of a multi-touch input device when an infrared light source of the multitouch input device is turned on, when the multi-touch input device is not being touched, and when an interface map is applied to an interface panel of the multitouch input device. The first digital image 1100 can be captured, for example, during startup process of the multi-touch input device (e.g., when the multi-touch input device is being powered-on or waking from a sleep mode). The first digital image 1100 can also be captured, for example, during a contamination detection operation (e.g., an automatic or manual contamination detection operation). The first digital image 1100 depicts infrared light that is scattered from any contamination present on the interface panel of the multi-touch input device. Specifically, there are three locations of scattered infrared light, 1102, 1104, and 1106, from contamination depicted in the first digital image 1100. The first digital image 1100 also depicts a faint outline of scattered infrared light from the interface map. Depending on the type of interface map used, infrared light may or may not be scattered by the interface map. Depending on implementation details, scattered infrared light from the interface map may or may not be processed as contamination and removed from subsequent images. [0110] 图 11A、11B 和 11C 是展示可检测并去除红外污染的示例数字图像的示意图。图 11A 中的第一数字图像 1100 表示：当多触点输入设备的红外光源开启、设备未被触摸且界面贴图已应用于设备界面面板时，由该设备数字相机捕获的数字图像。例如，第一数字图像 1100 可在多触点输入设备启动过程中捕获（如设备通电启动或从睡眠模式唤醒时）。该图像也可在污染检测操作期间捕获（如自动或手动污染检测操作）。第一数字图像 1100 显示了从多触点输入设备界面面板上污染物散射出的红外光。具体而言，图像中 1102、1104 和 1106 三处位置呈现了污染物导致的红外光散射现象。 第一幅数字图像 1100 还显示了来自界面映射的散射红外光的微弱轮廓。根据所使用的界面映射类型，红外光可能会被界面映射散射，也可能不会。根据具体实现细节，来自界面映射的散射红外光可能会被当作污染处理并从后续图像中移除，也可能不会。
[0111] The second digital image 1120 in Fig. 11B represents a digital image that is captured after the first digital image 1100. The second digital image 1120 can be one of a number of digital images captured during use of the multi-touch input device (e.g., when the multi-touch input device is being touched). The second digital image 1120 depicts infrared light scattered from three locations of contamination (1122, 1124, and 1126) which correspond to the three locations detected in the first digital 图 11B 中的第二数字图像 1120 表示在第一数字图像 1100 之后捕获的数字图像。第二数字图像 1120 可以是使用多点触控输入设备期间捕获的若干数字图像之一（例如当多点触控输入设备被触摸时）。该图像显示了从三个污染位置（1122、1124 和 1126）散射的红外光，这三个位置与第一数字图像中检测到的位置相对应。
image (1102, 1104, and 1106). The second digital image also depicts an additional location of scattered infrared light 1128. 图像（1102、1104 和 1106）。第二张数字图像还显示了散射红外光的另一处位置 1128。
[0112] Contamination information can be determined, at least in part, using the first digital image 1100. For example, the three locations of contamination (1102, 1104, and 1106) can be identified. The contamination information can be used to filter subsequent images. For example, the corresponding locations (1122, 1124, and 1126) in the second digital image 1120 can be filtered (e.g., removed or subtracted). Remaining locations (e.g., location 1128) can be identified as touch locations (e.g., as valid touch locations). [0112] 污染信息至少可以部分地通过第一数字图像 1100 来确定。例如，可以识别出三处污染位置（1102、1104 和 1106）。该污染信息可用于过滤后续图像。例如，第二数字图像 1120 中的对应位置（1122、1124 和 1126）可被过滤（如移除或减去）。剩余位置（如位置 1128）可被识别为触摸位置（即有效触摸位置）。
[0113] The third digital image 1140 in Fig. 11C represents a processed image in which the contamination present in the first digital image 1100, in addition to the interface map outline, has been removed from the second digital image 1120. The processed digital image 1140 depicts a touch location 1128 that remains after the contamination (including the interface map outline) has been removed. The remaining touch location 1128 can be identified as a valid touch location and processing of the touch location can be performed (e.g., a button press, touchpad movement, etc.). [0113] 图 11C 中的第三数字图像 1140 表示经过处理的图像，其中第一数字图像 1100 中存在的污染（包括界面映射轮廓）已从第二数字图像 1120 中移除。处理后的数字图像 1140 显示了移除污染（含界面映射轮廓）后保留的触摸位置 1128。该剩余触摸位置 1128 可被识别为有效触摸位置，并可对触摸位置执行相应处理（如按钮按下、触摸板移动等）。
[0114] Fig. 12 depicts a flowchart for an example method 1200 for removing contamination from digital images. At 1210, a first digital image is captured when an infrared light source of a FTIR multi-touch input device is turned and when an interface panel of the input device is not being touched. At 1220 , contamination information is determined based at least in part upon the first digital image. In some implementations, a reference digital image is captured prior to capturing the first digital image 1210 (e.g., during manufacturing). The reference digital image can be used, for example, in determining contamination information 1220 (e.g., the reference digital image can be used to distinguish between scattered infrared light from an interface map and scattered infrared light from other sources). [0114] 图 12 展示了一种用于去除数字图像污染的示例方法 1200 的流程图。在步骤 1210 中，当 FTIR 多点触控输入设备的红外光源开启且输入设备的界面面板未被触摸时，捕获第一幅数字图像。在步骤 1220 中，至少部分基于第一幅数字图像确定污染信息。某些实施方案中，在捕获第一幅数字图像 1210 之前（例如制造过程中）会先获取参考数字图像。该参考数字图像可用于确定污染信息 1220（例如，参考数字图像可用来区分来自界面映射的散射红外光与其他来源的散射红外光）。
[0115] At 1230, a plurality of digital images are captured after the first digital image. The plurality of additional digital images are captured when the infrared light [0115] 在步骤 1230 中，于获取第一幅数字图像后继续捕获多幅数字图像。这些附加数字图像是在红外光源
source is turned on. The plurality of additional digital images can be captured when the input device is being touched (e.g., when the input device is being used). 开启状态下获取的。当输入设备被触摸时（例如设备使用过程中），可捕获这些附加数字图像。
[0116] At 1240, the plurality of additional digital images are processed based at least in part upon the contamination information to remove contamination from the plurality of additional digital images. [0116] 在步骤 1240 中，基于至少部分污染信息对多个附加数字图像进行处理，以消除这些图像中的污染。
Touch and Rest触摸与搁置
[0117] Various types of touch events can be determined using a FTIR multi-touch input device. In some situations, it can be desirable to distinguish between different types of events, including touch (single, multiple, and/or simultaneous multiple), rest, and/or movement events. For example, during use of an input device, users may rest their fingers on the device (e.g., rest their fingers on a keyboard input device in the home position in preparation for the next keystroke). In order to avoid recognizing such rest events as touches (e.g., key presses), touch events can be distinguished from rest events. [0117] 利用 FTIR 多点触控输入设备可检测多种类型的触控事件。某些情况下，需要区分不同类型的事件，包括（单点、多点及/或同步多点）触摸、搁置及/或移动事件。例如，在使用输入设备时，用户可能将手指搁置在设备上（如将手指放在键盘输入设备的基准键位，为下一次击键做准备）。为避免将此类搁置事件误识别为触摸事件（如按键操作），需对触摸事件与搁置事件进行区分。
[0118] In some implementations, a touch is distinguished from a rest based at least in part upon duration. For example, a touch that lasts for more than one-half second can be determined to be a rest (e.g., and no key activation or touchpad movement events can be performed when a rest is detected). Additional criteria can be used to distinguish a rest from a touch. For example, movement criteria can be used in combination with duration to distinguish between a touch and a rest. In a specific implementation, a touch that lasts for more than one-half second and that moves less than 2 mm (e.g., as determined by movement of the center of the touch area) is considered to be a rest. [0118] 在某些实施方案中，至少部分依据持续时间来区分触摸与搁置。例如，持续超过半秒的触摸可被判定为搁置（例如，当检测到搁置时，不执行按键激活或触控板移动事件）。还可采用其他标准来区分搁置与触摸。例如，可将移动标准与持续时间结合使用以区分触摸和搁置。在具体实施方案中，持续超过半秒且移动距离小于 2 毫米（例如，根据触摸区域中心的移动判定）的触摸被视为搁置。
Example Computing Systems 示例计算系统
[0119] FIG. 13 depicts a generalized example of a suitable computing system 1300 in which the described innovations may be implemented. The computing system 1300 is not intended to suggest any limitation as to scope of use or functionality, as [0119] 图 13 展示了适用计算系统 1300 的通用示例，所描述的创新技术可在其中实施。该计算系统 1300 并非旨在对使用范围或功能提出任何限制，因为
the innovations may be implemented in diverse general-purpose or special-purpose computing systems. 创新技术可在多种通用或专用计算系统中实现。
[0120] With reference to FIG. 13, the computing system 1300 includes one or more processing units 1310, 1315 and memory 1320, 1325. In FIG. 13, this basic configuration 1330 is included within a dashed line. The processing units 1310, 1315 execute computer-executable instructions. A processing unit can be a generalpurpose central processing unit (CPU), processor in an application-specific integrated circuit (ASIC) or any other type of processor. In a multi-processing system, multiple processing units execute computer-executable instructions to increase processing power. For example, FIG. 13 shows a central processing unit 1310 as well as a graphics processing unit or co-processing unit 1315. The tangible memory 1320, 1325 may be volatile memory (e.g., registers, cache, RAM), nonvolatile memory (e.g., ROM, EEPROM, flash memory, etc.), or some combination of the two, accessible by the processing unit(s). The memory 1320, 1325 stores software 1380 implementing one or more innovations described herein, in the form of computer-executable instructions suitable for execution by the processing unit(s). [0120] 参照图 13，计算系统 1300 包含一个或多个处理单元 1310、1315 以及存储器 1320、1325。在图 13 中，该基础配置 1330 用虚线框标示。处理单元 1310、1315 执行计算机可执行指令。处理单元可以是通用中央处理器(CPU)、专用集成电路(ASIC)中的处理器或其他类型的处理器。在多处理系统中，多个处理单元通过执行计算机可执行指令来提升处理能力。例如，图 13 展示了中央处理器 1310 以及图形处理器/协处理器 1315。实体存储器 1320、1325 可以是易失性存储器（如寄存器、高速缓存、RAM）、非易失性存储器（如 ROM、EEPROM、闪存等）或二者的组合，可由处理单元访问。存储器 1320、1325 以适于处理单元执行的计算机可执行指令形式存储着实现本文所述创新的软件 1380。
[0121] A computing system may have additional features. For example, the computing system 1300 includes storage 1340, one or more input devices 1350, one or more output devices 1360, and one or more communication connections 1370. An interconnection mechanism (not shown) such as a bus, controller, or network interconnects the components of the computing system 1300. Typically, operating system software (not shown) provides an operating environment for other software executing in the computing system 1300, and coordinates activities of the components of the computing system 1300. [0121] 计算系统可具备附加功能。例如，计算系统 1300 包括存储装置 1340、一个或多个输入设备 1350、一个或多个输出设备 1360 以及一个或多个通信连接 1370。通过总线、控制器或网络等互连机制（未图示）将计算系统 1300 的各组件相互连接。通常，操作系统软件（未图示）为在计算系统 1300 中执行的其他软件提供运行环境，并协调计算系统 1300 各组件的活动。
[0122] The tangible storage 1340 may be removable or non-removable, and includes magnetic disks, magnetic tapes or cassettes, CD-ROMs, DVDs, or any other medium which can be used to store information in a non-transitory way and which can be accessed within the computing system 1300. The storage 1340 stores instructions for the software 1380 implementing one or more innovations described herein. [0122] 有形存储装置 1340 可以是可移动或不可移动的，其包括磁盘、磁带或盒式磁带、CD-ROM、DVD 或其他任何能以非瞬时方式存储信息且可在计算系统 1300 内访问的介质。存储装置 1340 存储用于实现本文所述一项或多项创新技术的软件 1380 的指令。
[0123] The input device(s) 1350 may be a touch input device such as a keyboard, mouse, pen, or trackball, a voice input device, a scanning device, or another device that provides input to the computing system 1300 . For video encoding, the input device(s) 1350 may be a camera, video card, TV tuner card, or similar device that accepts video input in analog or digital form, or a CD-ROM or CD-RW that reads video samples into the computing system 1300. The output device(s) 1360 may be a display, printer, speaker, CD-writer, or another device that provides output from the computing system 1300 . [0123] 输入设备 1350 可以是键盘、鼠标、手写笔或轨迹球等触摸输入设备，语音输入设备，扫描设备，或向计算系统 1300 提供输入的其他设备。对于视频编码，输入设备 1350 可以是摄像机、视频卡、电视调谐卡等以模拟或数字形式接收视频输入的设备，或是将视频样本读入计算系统 1300 的 CD-ROM 或 CD-RW。输出设备 1360 可以是显示器、打印机、扬声器、CD 刻录机等从计算系统 1300 输出信息的设备。
[0124] The communication connection(s) 1370 enable communication over a communication medium to another computing entity. The communication medium conveys information such as computer-executable instructions, audio or video input or output, or other data in a modulated data signal. A modulated data signal is a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media can use an electrical, optical, RF, or other carrier. [0124] 通信连接 1370 支持通过通信介质与其他计算实体进行通信。该通信介质可传输计算机可执行指令、音频/视频输入输出信息或其他调制数据信号中的信息。调制数据信号是指通过设置或改变其一个或多个特征来编码信息的信号。举例说明（非限制性），通信介质可采用电信号、光信号、射频信号或其他载波形式。
[0125] The innovations can be described in the general context of computerexecutable instructions, such as those included in program modules, being executed in a computing system on a target real or virtual processor. Generally, program modules include routines, programs, libraries, objects, classes, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The functionality of the program modules may be combined or split between program modules as desired in various embodiments. Computer-executable instructions for program modules may be executed within a local or distributed computing system. [0125] 这些创新技术可在计算机可执行指令的通用语境中进行描述，例如在目标真实或虚拟处理器上运行的、包含于程序模块中的指令。通常，程序模块包括执行特定任务或实现特定抽象数据类型的例程、程序、库、对象、类、组件、数据结构等。根据各实施例需求，程序模块的功能可进行组合或拆分。程序模块的计算机可执行指令可在本地或分布式计算系统中执行。
[0126] The terms “system” and “device” are used interchangeably herein. Unless the context clearly indicates otherwise, neither term implies any limitation on a type of computing system or computing device. In general, a computing system or computing device can be local or distributed, and can include any combination of special-purpose hardware and/or general-purpose hardware with software implementing the functionality described herein. [0126] 本文中"系统"与"设备"两术语可互换使用。除非上下文另有明确说明，这两个术语均不对计算系统或计算设备的类型构成任何限制。一般而言，计算系统或计算设备可以是本地或分布式的，并且可以包含专用硬件和/或搭载实现本文所述功能的通用硬件与软件的任何组合。
[0127] For the sake of presentation, the detailed description uses terms like “determine” and “use” to describe computer operations in a computing system. These terms are high-level abstractions for operations performed by a computer, and should not be confused with acts performed by a human being. The actual computer operations corresponding to these terms vary depending on implementation. [0127] 为便于说明，本详细描述采用"确定"、"使用"等术语来描述计算系统中的计算机操作。这些术语是对计算机执行操作的高级抽象，不应与人类行为相混淆。这些术语对应的实际计算机操作会因具体实现方式而有所不同。
Example Implementations示例性实施方式
[0128] Although the operations of some of the disclosed methods are described in a particular, sequential order for convenient presentation, it should be understood that this manner of description encompasses rearrangement, unless a particular ordering is required by specific language set forth below. For example, operations described sequentially may in some cases be rearranged or performed concurrently. Moreover, for the sake of simplicity, the attached figures may not show the various ways in which the disclosed methods can be used in conjunction with other methods. [0128] 虽然出于表述便利，部分公开方法的操作步骤以特定顺序进行描述，但应理解这种描述方式包含顺序调整的可能性，除非下文特别说明需要特定顺序。例如，顺序描述的操作在某些情况下可重新排列或并发执行。此外，为简洁起见，附图可能未展示所公开方法与其他方法结合使用的各种方式。
[0129] Any of the disclosed methods can be implemented as computer-executable instructions or a computer program product stored on one or more computerreadable storage media and executed on a computing device (e.g., any available computing device, including smart phones or other mobile devices that include computing hardware). Computer-readable storage media are any available tangible media that can be accessed within a computing environment (e.g., non-transitory computer-readable media, such as one or more optical media discs such as DVD or CD, volatile memory components (such as DRAM or SRAM), or nonvolatile memory components (such as flash memory or hard drives)). By way of example and with reference to Fig. 13, computer-readable storage media include memory 1320 and 1325, and storage 1340. As should be readily understood, the term computer-readable storage media does not include communication connections (e.g., 1370)1370) such as modulated data signals. [0129] 任何所公开的方法均可实现为计算机可执行指令或计算机程序产品，存储于一个或多个计算机可读存储介质上，并在计算设备（例如任何可用的计算设备，包括包含计算硬件的智能手机或其他移动设备）上执行。计算机可读存储介质是指计算环境中可访问的任何有形介质（例如非瞬时性计算机可读介质，诸如一个或多个 DVD 或 CD 等光学介质盘、易失性存储组件（如 DRAM 或 SRAM）、或非易失性存储组件（如闪存或硬盘驱动器））。举例而言并参考图 13，计算机可读存储介质包括存储器 1320 和 1325，以及存储装置 1340。应当容易理解的是，计算机可读存储介质这一术语不包括通信连接（例如 1370)1370) 诸如调制数据信号）。
[0130] Any of the computer-executable instructions for implementing the disclosed techniques as well as any data created and used during implementation of the disclosed embodiments can be stored on one or more computer-readable storage [0130] 用于实现所公开技术的任何计算机可执行指令以及在实现所公开实施例过程中创建和使用的任何数据均可存储在一个或多个计算机可读存储介质上
media (e.g., non-transitory computer-readable media). The computer-executable instructions can be part of, for example, a dedicated software application or a software application that is accessed or downloaded via a web browser or other software application (such as a remote computing application). Such software can be executed, for example, on a single local computer (e.g., any suitable commercially available computer) or in a network environment (e.g., via the Internet, a wide-area network, a local-area network, a client-server network (such as a cloud computing network), or other such network) using one or more network computers. 媒体（例如，非临时性计算机可读媒体）。这些计算机可执行指令可以是例如专用软件应用程序的一部分，或是通过网页浏览器或其他软件应用程序（如远程计算应用程序）访问或下载的软件应用程序的一部分。此类软件可在单个本地计算机（例如任何合适的商用计算机）上执行，也可在网络环境（例如通过互联网、广域网、局域网、客户端-服务器网络（如云计算网络）或其他类似网络）中使用一台或多台网络计算机来执行。
[0131] For clarity, only certain selected aspects of the software-based implementations are described. Other details that are well known in the art are omitted. For example, it should be understood that the disclosed technology is not limited to any specific computer language or program. For instance, the disclosed technology can be implemented by software written in C++, Java, Perl, JavaScript, Adobe Flash, or any other suitable programming language. Likewise, the disclosed technology is not limited to any particular computer or type of hardware. Certain details of suitable computers and hardware are well known and need not be set forth in detail in this disclosure. [0131] 为清晰起见，本文仅描述基于软件实现的某些特定方面。本领域公知的其他细节予以省略。例如，应当理解所公开的技术并不限于任何特定的计算机语言或程序。举例而言，该技术可通过 C++、Java、Perl、JavaScript、Adobe Flash 或任何其他合适编程语言编写的软件实现。同样地，所公开的技术也不限于任何特定计算机或硬件类型。关于适用计算机及硬件的具体细节已为本领域所熟知，无需在本说明书中详细阐述。
[0132] Furthermore, any of the software-based embodiments (comprising, for example, computer-executable instructions for causing a computer to perform any of the disclosed methods) can be uploaded, downloaded, or remotely accessed through a suitable communication means. Such suitable communication means include, for example, the Internet, the World Wide Web, an intranet, software applications, cable (including fiber optic cable), magnetic communications, electromagnetic communications (including RF, microwave, and infrared communications), electronic communications, or other such communication means. [0132] 此外，任何基于软件的实施例（例如包含使计算机执行所公开方法的计算机可执行指令）均可通过适当的通信手段进行上传、下载或远程访问。此类适当的通信手段包括但不限于：互联网、万维网、内联网、软件应用程序、有线通信（含光纤电缆）、磁通信、电磁通信（包括射频通信、微波通信和红外通信）、电子通信或其他类似通信方式。
[0133] The disclosed methods, apparatus, and systems should not be construed as limiting in any way. Instead, the present disclosure is directed toward all novel and nonobvious features and aspects of the various disclosed embodiments, alone and in various combinations and sub combinations with one another. The disclosed [0133] 所公开的方法、装置及系统不应被解释为具有任何限制性。相反，本公开涵盖各种实施例中所有新颖且非显而易见的特征与方面，包括其单独存在形式以及彼此之间各种组合与子组合形式。所公开的
methods, apparatus, and systems are not limited to any specific aspect or feature or combination thereof, nor do the disclosed embodiments require that any one or more specific advantages be present or problems be solved. 方法、装置及系统不受限于任何特定方面、特征或其组合，且所公开实施例亦不要求必须实现任何特定优势或解决特定问题。
Alternatives替代方案
[0134] The technologies from any example or implementation can be combined with the technologies described in any one or more of the other examples or implementations. In view of the many possible embodiments to which the principles of the disclosed technology may be applied, it should be recognized that the illustrated embodiments are examples of the disclosed technology and should not be taken as a limitation on the scope of the disclosed technology. Rather, the scope of the disclosed technology includes what is covered by the following claims. I therefore claim as my invention all that comes within the scope and spirit of the claims. [0134] 任一示例或实施方式中的技术均可与其他一个或多个示例或实施方式中描述的技术相结合。鉴于所公开技术的原理可应用于众多可能的实施例，应当理解所示实施例仅为该技术的示例，不应视为对其范围的限制。相反，所公开技术的范围涵盖所附权利要求书界定的全部内容。因此，凡属于权利要求范围和主旨内的所有内容，均视为本发明要求保护的发明内容。
I claim:权利要求书
A method, implemented at least in part by a frustrated total internal reflection (FTIR) multi-touch input device, for removing interference, the method comprising: 一种通过受抑全内反射(FTIR)多点触控输入设备至少部分实现的消除干扰方法，包括：
capturing, via a digital camera of the FTIR multi-touch input device, a first digital image, wherein the first digital image is captured when an infrared light source of the FTIR multi-touch input device is turned off; 通过 FTIR 多点触控输入设备的数码相机捕获第一数字图像，其中所述第一数字图像是在 FTIR 多点触控输入设备的红外光源关闭状态下获取的；
capturing, via the digital camera of the FTIR multi-touch input device, a second digital image, wherein the second digital image is captured when the infrared light source of the FTIR multi-touch input device is turned on; and 通过 FTIR 多点触控输入设备的数码相机捕获第二数字图像，其中第二数字图像是在 FTIR 多点触控输入设备的红外光源开启时捕获的；以及
processing, at least in part by the FTIR multi-touch input device, the first and second digital images to remove infrared interference. 至少部分地通过 FTIR 多点触控输入设备处理第一和第二数字图像以消除红外干扰。
The method of claim 1 wherein the processing comprises: 根据权利要求 1 所述的方法，其中所述处理包括：
filtering the second digital image, based at least in part upon the first digital image, to remove infrared interference. 至少部分地基于第一数字图像对第二数字图像进行滤波以消除红外干扰。
The method of claim 1 wherein the processing comprises: 根据权利要求 1 所述的方法，其中所述处理包括：
filtering the second digital image, based at least in part upon the first digital image, to subtract infrared interference present in the first digital image from the second digital image. 至少部分基于所述第一数字图像对所述第二数字图像进行滤波，以从所述第二数字图像中减去存在于所述第一数字图像中的红外干扰。
The method of claim 1 wherein the processing comprises: determining whether infrared interference is present in the first digital image; and 根据权利要求 1 所述的方法，其中所述处理包括：确定所述第一数字图像中是否存在红外干扰；以及
when infrared interference is present in the first digital image: 当所述第一数字图像中存在红外干扰时：
filtering the second digital image, based at least in part upon the first image, to remove the infrared interference. 基于第一图像至少部分地对第二数字图像进行滤波，以消除红外干扰。
The method of claim 1 wherein the processing comprises: generating, using at least in part the first digital image and the second digital image, a processed digital image representing the second digital image with the infrared interference removed. 根据权利要求 1 所述的方法，其中所述处理包括：至少部分地利用第一数字图像和第二数字图像生成处理后的数字图像，该图像表示已消除红外干扰的第二数字图像。
The method of claim 1 wherein the processing comprises: determining whether infrared interference is present in the first digital image; and 根据权利要求 1 所述的方法，其中所述处理包括：判断第一数字图像中是否存在红外干扰；以及
when infrared interference is present in the first digital image: determining whether the infrared interference is present in the second digital image; and 当第一数字图像中存在红外干扰时：判断第二数字图像中是否存在红外干扰；以及
when the infrared interference is present in the second digital image, generating, using at least in part the first digital image and the second digital image, a processed digital image representing the second digital image with the infrared interference removed. 当第二数字图像中存在红外干扰时，至少部分利用第一数字图像和第二数字图像生成处理后的数字图像，该图像表示已去除红外干扰的第二数字图像。
The method of claim 1 wherein the processing comprises: determining locations of infrared interference in the first digital image; determining locations of potential touch events in the second digital image; and 根据权利要求 1 所述的方法，其中处理包括：确定第一数字图像中红外干扰的位置；确定第二数字图像中潜在触摸事件的位置；以及
removing those potential touch event locations that match the locations of infrared interference. 移除与红外干扰位置相匹配的那些潜在触摸事件位置。
The method of claim 1 wherein the infrared light source is configured to emit infrared light inside an interface panel of the FTIR multi-touch input device using total internal reflection, and wherein infrared interference is from a different source than the infrared light source. 根据权利要求 1 所述的方法，其中红外光源被配置为利用全内反射在 FTIR 多点触控输入设备的界面面板内发射红外光，且所述红外干扰来自不同于该红外光源的其他来源。
The method of claim 1 wherein the infrared light source of the FTIR multi-touch input device switches, between on and off, between successive images captured by the digital camera. 根据权利要求 1 所述的方法，其中所述 FTIR 多点触控输入设备的红外光源在数字相机连续捕获的图像之间进行开关切换。
The method of claim 1 wherein the digital camera of the FTIR multitouch input device is configured to capture images at a first rate of a number of images per second, and wherein the infrared light source flashes at a second rate less than the first rate. 根据权利要求 1 所述的方法，其中所述 FTIR 多点触控输入设备的数字相机配置为以第一速率每秒捕获若干图像，且所述红外光源以低于第一速率的第二速率闪烁。
A frustrated total internal reflection (FTIR) multi-touch input device, the input device comprising: 一种受抑全内反射(FTIR)多点触控输入设备，该输入设备包括：
a transparent interface panel; 透明界面面板；
an infrared light source for emitting infrared light inside the interface panel using total internal reflection; and 一种红外光源，用于通过全内反射在界面面板内部发射红外光；
a digital camera, wherein the digital camera is configured to detect infrared light that is scattered from the interface panel using FTIR when the interface panel is touched; 一台数码相机，其中该数码相机被配置为当界面面板被触摸时，利用受抑全内反射检测从界面面板散射的红外光；
wherein the input device is configured to perform operations comprising: detecting infrared interference based at least in part from digital images captured using the digital camera when the infrared light source is off; and compensating for the detected infrared interference in digital images captured using the digital camera when the infrared light source is on. 其中所述输入设备被配置为执行包括以下步骤的操作：基于红外光源关闭时数码相机拍摄的数字图像至少部分地检测红外干扰；并对红外光源开启时数码相机拍摄的数字图像中检测到的红外干扰进行补偿。
The input device of claim 11 wherein the compensating comprises: 如权利要求 11 所述的输入设备，其中所述补偿包括：
filtering the digital images captured when the infrared light source is on to remove the detected infrared interference. 对红外光源开启时捕获的数字图像进行过滤，以消除检测到的红外干扰。
The input device of claim 11 wherein the compensating comprises: determining whether infrared interference is present in a first digital image, wherein the first digital image is captured using the digital camera when the infrared light source is off; and 根据权利要求 11 所述的输入设备，其中所述补偿包括：判断第一数字图像中是否存在红外干扰，其中所述第一数字图像是在红外光源关闭时通过数码相机捕获的；以及
when infrared interference is present in the first digital image: 当所述第一数字图像中存在红外干扰时：
filtering a second digital image, based at least in part upon the first 至少部分基于所述第一数字图像对第二数字图像进行过滤
image, to remove the infrared interference, wherein the second digital image is captured using the digital camera when the infrared light source is on. 图像，用于消除红外干扰，其中第二数字图像是在红外光源开启时通过数码相机拍摄的。
The input device of claim 11 wherein the compensating comprises: generating processed digital images by subtracting the detected infrared interference from the digital images captured when the infrared light source is on. 根据权利要求 11 所述的输入设备，其中所述补偿包括：通过从红外光源开启时拍摄的数字图像中减去检测到的红外干扰来生成处理后的数字图像。
The input device of claim 11 wherein the digital camera is configured to capture images at a first rate, wherein the infrared light source is configured to flicker at a second rate, wherein the first rate is greater than the second rate. 根据权利要求 11 所述的输入设备，其中所述数码相机配置为以第一速率拍摄图像，所述红外光源配置为以第二速率闪烁，且第一速率大于第二速率。
A method, implemented at least in part by a frustrated total internal reflection (FTIR) multi-touch input device, for removing contamination from digital images, the method comprising: 一种至少部分通过受抑全内反射(FTIR)多点触控输入设备实现的、用于消除数字图像污染的方法，该方法包括：
capturing, via a digital camera of the FTIR multi-touch input device, a first digital image, wherein the first digital image is captured when an infrared light source of the FTIR multi-touch input device is turned on, and wherein the first digital image is captured when an interface panel of the FTIR multi-touch input device is not being touched; 通过 FTIR 多点触控输入设备的数码相机捕获第一数字图像，其中第一数字图像是在 FTIR 多点触控输入设备的红外光源开启时捕获的，且捕获时设备界面面板未被触摸；
determining contamination information based at least in part upon the first digital image, wherein the contamination information is determined from detected infrared light present in the first digital image; 至少部分基于第一数字图像确定污染信息，其中污染信息是从第一数字图像中检测到的红外光提取的；
capturing, via the digital camera of the FTIR multi-touch input device, a plurality of additional digital images, wherein the plurality of additional digital images are captured when the infrared light source of the FTIR multi-touch input device is turned on; and 通过 FTIR 多点触控输入设备的数码相机捕获多张附加数字图像，其中这些附加数字图像是在 FTIR 多点触控输入设备的红外光源开启时捕获的；
processing, at least in part by the FTIR multi-touch input device, the plurality of additional digital images based at least in part upon the contamination information to remove contamination from the plurality of additional digital images. 由 FTIR 多点触控输入设备至少部分基于污染信息对多张附加数字图像进行处理，以消除这些图像中的污染。
The method of claim 16 further comprising: 权利要求 16 的方法还包括：
capturing, via a digital camera of the FTIR multi-touch input device, a reference digital image at an earlier time than the first digital image, wherein the reference digital image is captured when an infrared light source of the FTIR multi- touch input device is turned on, wherein the reference digital image is captured when an interface panel of the FTIR multi-touch input device is not being touched, and wherein the reference digital image is captured when an interface map is attached to the interface panel; 通过 FTIR 多点触控输入设备的数码相机，在早于第一数码图像的时点拍摄参考数码图像，其中参考数码图像是在 FTIR 多点触控输入设备的红外光源开启时拍摄的，参考数码图像是在 FTIR 多点触控输入设备的界面面板未被触碰时拍摄的，且参考数码图像是在界面地图附着于界面面板时拍摄的；
wherein the determining contamination information is also based at least in part upon comparing the reference digital image to the first digital image. 其中确定污染信息还至少部分基于将参考数码图像与第一数码图像进行比较。
The method of claim 16 wherein the processing comprises: 权利要求 16 的方法，其中所述处理包括：
for each of the plurality of additional digital images: 对于每一个附加数字图像：
filtering the additional digital image, based at least in part upon the contamination information, to remove detected infrared light present in the additional digital image that is due to contamination. 基于至少部分污染信息对该附加数字图像进行过滤，以去除由于污染而存在于附加数字图像中的检测到的红外光。
The method of claim 16 wherein the processing comprises: 根据权利要求 16 所述的方法，其中所述处理包括：
for each of the plurality of additional digital images: 对于每一个附加数字图像：
generating, using at least in part the contamination information, a processed digital image representing the additional digital image with the contamination removed. 利用污染信息至少部分生成处理后的数字图像，该图像代表已去除污染的附加数字图像。
The method of claim 16 wherein the contamination represents debris present on the interface panel of the multi-touch input device that scatters at least a portion of infrared light emitted by an infrared light source of the multi-touch input device. 根据权利要求 16 所述的方法，其中所述污染代表存在于多点触控输入设备界面面板上的碎屑，这些碎屑会散射该设备红外光源发射的至少部分红外光。
The method of claim 16 wherein the first digital image is captured during an initialization process of the multi-touch input device and used by the 根据权利要求 16 所述的方法，其中所述第一数字图像是在多点触控输入设备初始化过程中捕获的，并由该设备使用
multi-touch input device until a subsequent initialization process is used to capture a new first digital image. 直到通过后续初始化过程捕获新的第一数字图像为止。
FIG. 2图 2
200
" 100, "200\text { 100, } 200
Figure 2: FIG. 3图 2：图 3
\captionsetup{labelformat=empty}
Figure 3: FIG. 4图 3：图 4
\captionsetup{labelformat=empty}
Figure 4: FIG. 5图 4：图 5
\captionsetup{labelformat=empty}
Figure 5: FIG. 6B图 5：图 6B
\captionsetup{labelformat=empty}
Figure 6: FIG. 7图 6：图 7
\captionsetup{labelformat=empty}
Figure 7: FIG. 8图 7：图 8
\captionsetup{labelformat=empty}
900
Figure 8: FIG. 9A图 8：图 9A
\captionsetup{labelformat=empty}
Figure 9: FIG. 9B图 9：图 9B
\captionsetup{labelformat=empty}
FIG. 9C图 9C
Figure 10: FIG. 10图 10: 图 10
\captionsetup{labelformat=empty}
FIG. 12图 12
CAPTURE FIRST DIGITAL IMAGE 捕获第一张数字图像
DETERMINE CONTAMINATION INFORMATION 确定污染信息
1220
CAPTURE PLURALITY OF ADDITIONAL DIGITAL IMAGES 捕获多张附加数字图像
1230
PROCESS THE PLURALITY OF DIGITAL IMAGES TO REMOVE CONTAMINATION 对多幅数字图像进行处理以消除污染
1240
Figure 11: FIG. 13图 11：图 13
\captionsetup{labelformat=empty}
SOFTWARE 1480 IMPLEMENTING DESCRIBED TECHNOLOGIES 实现所述技术的软件 1480
According to International Patent Classification (IPC) or to both national classification and IPC
A. CLASSIFICATION OF SUBJECT MATTER
IPC(8) - G06F 3/042 (2012.01)
USPC - 345/175
According to International Patent Classification (IPC) or to both national classification and IPC| A. CLASSIFICATION OF SUBJECT MATTER |
| :--- |
| IPC(8) - G06F 3/042 (2012.01) |
| USPC - 345/175 |
| According to International Patent Classification (IPC) or to both national classification and IPC |
Minimum documentation searched (classification system followed by classification symbols)
IPC(8) Classification(s): G06F 3/042, G06F 3/041 (2012.01)
USPC Classification(s): 345/175, 345/173; 178/18.01, 178/18.09; 382/275| Minimum documentation searched (classification system followed by classification symbols) |
| :--- |
| IPC(8) Classification(s): G06F 3/042, G06F 3/041 (2012.01) |
| USPC Classification(s): 345/175, 345/173; 178/18.01, 178/18.09; 382/275 |
Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 除最低文献量外，经检索的文献范围还包括检索领域内的其他文献
FTIR, total internal reflection, infrared, background subtraction, image, contamination
Electronic data base consulted during the international search (name of data base and, where practicable, search terms used)
MicroPatent (US Granted, US Applications, EP-A, EP-B, WO, JP, DE-G, DE-A, DE-T, DE-U, GB-A, FR-A); DialogPro (Derwent, INSPEC, NTIS, PASCAL, Current Contents Search, Dissertation Abstracts Online, Inside Conferences); IP.com; Google; Search Terms Used:
FTIR, total internal reflection, infrared, background subtraction, image, contamination| Electronic data base consulted during the international search (name of data base and, where practicable, search terms used) |
| :--- |
| MicroPatent (US Granted, US Applications, EP-A, EP-B, WO, JP, DE-G, DE-A, DE-T, DE-U, GB-A, FR-A); DialogPro (Derwent, INSPEC, NTIS, PASCAL, Current Contents Search, Dissertation Abstracts Online, Inside Conferences); IP.com; Google; Search Terms Used: |
| FTIR, total internal reflection, infrared, background subtraction, image, contamination |
C. DOCUMENTS CONSIDERED TO BE RELEVANT C. 被视为相关的文献
Category*文献类别*
Citation of document, with indication, where appropriate, of the relevant passages 引用的文件，并酌情注明相关段落
Relevant to claim No. 与权利要求编号相关
X
bar(Y)\bar{Y}
X
bar(Y)| X |
| :--- |
| $\bar{Y}$ |
US 2011/0216042 A1 (WASSVIK, O. et al.) September 8, 2011, Paragraphs [0037], [0059], [0063], [0078] and [0089] US 2011/0216042 A1（WASSVIK, O. 等人）2011 年 9 月 8 日，第[0037]、[0059]、[0063]、[0078]和[0089]段
"A" document defining the general state of the art which is not considered to be of particular relevance
"T" later document published after the international filing date or priority date and not in conflict with the application but cited to understand the principle or theory underlying the invention
* Special categories of cited documents:
"A" document defining the general state of the art which is not considered to be of particular relevance
"T" later document published after the international filing date or priority date and not in conflict with the application but cited to understand the principle or theory underlying the invention| * Special categories of cited documents: |
| :--- |
| "A" document defining the general state of the art which is not considered to be of particular relevance |
| "T" later document published after the international filing date or priority date and not in conflict with the application but cited to understand the principle or theory underlying the invention |
"E" earlier application or patent but published on or after the international filing date
"L" document which may throw doubts on priority claim(s) or which is cited to establish the publication date of another citation or other special reason (as specified)
"E" earlier application or patent but published on or after the international filing date
"L" document which may throw doubts on priority claim(s) or which is cited to establish the publication date of another citation or other special reason (as specified)| "E" earlier application or patent but published on or after the international filing date |
| :--- |
| "L" document which may throw doubts on priority claim(s) or which is cited to establish the publication date of another citation or other special reason (as specified) |
document published prior to the international filing date but later than the priority date claimed 在国际申请日之前公布但在所要求优先权日之后公开的文献
" X " document of particular relevance; the claimed invention cannot be considered novel or cannot be considered to involve an inventive "X"类特别相关文献；要求保护的发明不具备新颖性或创造性
国际检索实际完成日期 2012 年 9 月 2 日 (02.09.2012)
Date of the actual completion of the international search
2 September 2012 (02.09.2012)
Date of the actual completion of the international search
2 September 2012 (02.09.2012)| Date of the actual completion of the international search |
| :--- |
| 2 September 2012 (02.09.2012) |
国际检索报告邮寄日期 2012 年 10 月 16 日
Date of mailing of the international search report
16 OCT 2012
Date of mailing of the international search report
16 OCT 2012| Date of mailing of the international search report |
| :--- |
| 16 OCT 2012 |
"A. CLASSIFICATION OF SUBJECT MATTER
IPC(8) - G06F 3/042 (2012.01)
USPC - 345/175
According to International Patent Classification (IPC) or to both national classification and IPC"
B. FIELDS SEARCHED
"Minimum documentation searched (classification system followed by classification symbols)
IPC(8) Classification(s): G06F 3/042, G06F 3/041 (2012.01)
USPC Classification(s): 345/175, 345/173; 178/18.01, 178/18.09; 382/275"
Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched
"Electronic data base consulted during the international search (name of data base and, where practicable, search terms used)
MicroPatent (US Granted, US Applications, EP-A, EP-B, WO, JP, DE-G, DE-A, DE-T, DE-U, GB-A, FR-A); DialogPro (Derwent, INSPEC, NTIS, PASCAL, Current Contents Search, Dissertation Abstracts Online, Inside Conferences); IP.com; Google; Search Terms Used:
FTIR, total internal reflection, infrared, background subtraction, image, contamination"
C. DOCUMENTS CONSIDERED TO BE RELEVANT
Category* Citation of document, with indication, where appropriate, of the relevant passages Relevant to claim No.
"X
bar(Y)" US 2011/0216042 A1 (WASSVIK, O. et al.) September 8, 2011, Paragraphs [0037], [0059], [0063], [0078] and [0089] "1-3,5,8,11,12,14
4,6,7,9,10,13,15-21"
Y US 8,004,502 B2 (KEAM, N.) August 23, 2011, Column 3, Lines 20-22 and Column 4, Lines 28-31 4,6,9,10,13,15
Y US 5,196,835 A (BLUE, L. et al.) March 23, 1993, Column 2, Lines 12-16, Column 4, Lines 67-68, and Column 5, Lines 1-3 7,16-21
Y US 8,026,904 B2 (WESTERMAN, W.) September 27, 2011, Column 3, Line 58 to Column 4, Line 9 17
Y US 2011/0109594 A1 (MARCUS, B.) May 12, 2011, Paragraphs [0009], [0034], [0058] 17
Further documents are listed in the continuation of Box C. ◻
"* Special categories of cited documents:
"A" document defining the general state of the art which is not considered to be of particular relevance
"T" later document published after the international filing date or priority date and not in conflict with the application but cited to understand the principle or theory underlying the invention"
"P" ""E" earlier application or patent but published on or after the international filing date
"L" document which may throw doubts on priority claim(s) or which is cited to establish the publication date of another citation or other special reason (as specified)" document published prior to the international filing date but later than the priority date claimed " X " document of particular relevance; the claimed invention cannot be considered novel or cannot be considered to involve an inventive
"Date of the actual completion of the international search
2 September 2012 (02.09.2012)" "Date of mailing of the international search report
16 OCT 2012"
"Mail Stop PCT, Attn: ISA/US, Commissioner for Patents
P.O. Box 1450, Alexandria, Virginia 22313-1450
Facsimile No. 571-273-3201" "Shane Thomas
PCT Helpdesk: 571-272-4300
PCT OSP: 571-272-7774" | A. CLASSIFICATION OF SUBJECT MATTER <br> IPC(8) - G06F 3/042 (2012.01) <br> USPC - 345/175 <br> According to International Patent Classification (IPC) or to both national classification and IPC | | | |
| :--- | :--- | :--- | :--- |
| B. FIELDS SEARCHED | | | |
| Minimum documentation searched (classification system followed by classification symbols) <br> IPC(8) Classification(s): G06F 3/042, G06F 3/041 (2012.01) <br> USPC Classification(s): 345/175, 345/173; 178/18.01, 178/18.09; 382/275 | | | |
| Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched | | | |
| Electronic data base consulted during the international search (name of data base and, where practicable, search terms used) <br> MicroPatent (US Granted, US Applications, EP-A, EP-B, WO, JP, DE-G, DE-A, DE-T, DE-U, GB-A, FR-A); DialogPro (Derwent, INSPEC, NTIS, PASCAL, Current Contents Search, Dissertation Abstracts Online, Inside Conferences); IP.com; Google; Search Terms Used: <br> FTIR, total internal reflection, infrared, background subtraction, image, contamination | | | |
| C. DOCUMENTS CONSIDERED TO BE RELEVANT | | | |
| Category* | Citation of document, with indication, where appropriate, of the relevant passages | | Relevant to claim No. |
| X <br> $\bar{Y}$ | US 2011/0216042 A1 (WASSVIK, O. et al.) September 8, 2011, Paragraphs [0037], [0059], [0063], [0078] and [0089] | | 1-3,5,8,11,12,14 <br> 4,6,7,9,10,13,15-21 |
| Y | US 8,004,502 B2 (KEAM, N.) August 23, 2011, Column 3, Lines 20-22 and Column 4, Lines 28-31 | | 4,6,9,10,13,15 |
| Y | US 5,196,835 A (BLUE, L. et al.) March 23, 1993, Column 2, Lines 12-16, Column 4, Lines 67-68, and Column 5, Lines 1-3 | | 7,16-21 |
| Y | US 8,026,904 B2 (WESTERMAN, W.) September 27, 2011, Column 3, Line 58 to Column 4, Line 9 | | 17 |
| Y | US 2011/0109594 A1 (MARCUS, B.) May 12, 2011, Paragraphs [0009], [0034], [0058] | | 17 |
| Further documents are listed in the continuation of Box C. $\square$ | | | |
| * Special categories of cited documents: <br> "A" document defining the general state of the art which is not considered to be of particular relevance <br> "T" later document published after the international filing date or priority date and not in conflict with the application but cited to understand the principle or theory underlying the invention | | | |
| "P" | "E" earlier application or patent but published on or after the international filing date <br> "L" document which may throw doubts on priority claim(s) or which is cited to establish the publication date of another citation or other special reason (as specified) | document published prior to the international filing date but later than the priority date claimed | " X " document of particular relevance; the claimed invention cannot be considered novel or cannot be considered to involve an inventive |
| Date of the actual completion of the international search <br> 2 September 2012 (02.09.2012) | | Date of mailing of the international search report <br> 16 OCT 2012 | |
| Mail Stop PCT, Attn: ISA/US, Commissioner for Patents <br> P.O. Box 1450, Alexandria, Virginia 22313-1450 <br> Facsimile No. 571-273-3201 | | Shane Thomas <br> PCT Helpdesk: 571-272-4300 <br> PCT OSP: 571-272-7774 | |
导出提示
谨慎下载超过 300 页以上 PDF，容易内存溢出。
PDF Pro 下载需借用浏览器的打印功能，出现打印界面后，在【打印机】处选择【另存为 PDF】，最后点击【保存】即可。
