Patents

US 10839792 B2: Recognition of out-of-vocabulary in direct acoustics-to-word speech recognition using acoustic word embedding

Granted
2020-11-17
Filed
2019-02-05 application 16267489
Type
Utility · 25 claims
Elsewhere
Google Patents ↗ · USPTO patent document ↗ · USPTO Patent Center record ↗

Abstract

A method (and structure and computer product) for learning Out-of-Vocabulary (OOV) words in an Automatic Speech Recognition (ASR) system includes using an Acoustic Word Embedding Recurrent Neural Network (AWE RNN) to receive a character sequence for a new OOV word for the ASR system, the RNN providing an Acoustic Word Embedding (AWE) vector as an output thereof. The AWE vector output from the AWE RNN is provided as an input into an Acoustic Word Embedding-to-Acoustic-to-Word Neural Network (AWE→A2W NN) trained to provide an OOV word weight value from the AWE vector. The OOV word weight is inserted into a listing of Acoustic-to-Word (A2W) word embeddings used by the ASR system to output recognized words from an input of speech acoustic features, wherein the OOV word weight is inserted into the A2W word embeddings list relative to existing weights in the A2W word embeddings list.

Source: PVGPATDIS, file of 2026-04-10 (ipg201117.xml).

Assignees

AssigneeTypePlaceAlso on furp.orgSource
International Business Machines Corporation 105,769 patentsUS company or organizationArmonk, NYINTERNATIONAL BUSINESS MACHINES CORP SEC filer FUZZY low confidence: same name (legal endings aside), one of each nationallyPVGPATDIS, file of 2026-04-10
Toyota Technological Institute at Chicago 7 patentsUS company or organizationChicago, ILToyota Technological Institute at Chicago College or university EXACT high confidence: identical full name and state
TOYOTA TECHNOLOGICAL INSTITUTE AT CHICAGO Nonprofit EXACT high confidence: identical full name and state
PVGPATDIS, file of 2026-04-10

Inventors

InventorPlacePatentsPerson pageSource
Kartik AudhkhasiWhite Plains, NY21PVGPATDIS, file of 2026-04-10
Karen LivescuYorktown Heights, NY1PVGPATDIS, file of 2026-04-10
Michael A. PichenyWhite Plains, NY19PVGPATDIS, file of 2026-04-10
Shane SettleYorktown Heights, NY2PVGPATDIS, file of 2026-04-10

CPC categories

SubclassCategoryFirst groupSource
G10LSpeech analysis techniques or speech synthesis; speech recognition; speech or voice processing techniques; speech or audio coding or decodingG10L15/16PVGPATDIS, file of 2026-04-10
G06NComputing arrangements based on specific computational modelsG06N3/044PVGPATDIS, file of 2026-04-10

Cooperative Patent Classification, as currently assigned (one row per subclass).

Assignments and security interests

RecordedWhatFromToReel/frameSource
2020-03-05Assignment
Assignment of assignor's interest
INTERNATIONAL BUSINESS MACHINES CORPORATION signed 2020-03-02TOYOTA TECHNOLOGICAL INSTITUTE AT CHICAGO CHICAGO, IL
INTERNATIONAL BUSINESS MACHINES CORPORATION ARMONK, NY
52031/112ECORSEXC, file of 2026-09-25
2019-02-14Correction
Corrective assignment to correct the property number previously recorded at reel: 48245 frame: 473. assignor(s) hereby confirms the assignment.
AUDHKHASI, KARTIK signed 2019-01-30
LIVESCU, KAREN signed 2019-01-31
PICHENY, MICHAEL signed 2019-01-31
SETTLE, SHANE signed 2019-02-03
INTERNATIONAL BUSINESS MACHINES CORPORATION ARMONK, NY49949/695ECORSEXC, file of 2026-09-25
2019-02-13Assignment
Assignment of assignor's interest
AUDHKHASI, KARTIK signed 2019-01-30
LIVESCU, KAREN signed 2019-01-31
PICHENY, MICHAEL signed 2019-01-31
SETTLE, SHANE signed 2019-02-03
INTERNATIONAL BUSINESS MACHINES CORPORATION ARMONK, NY48316/65ECORSEXC, file of 2026-09-25

Documents recorded with the USPTO Assignment Recordation Branch that list this patent. A security interest is a lender’s claim on the patent as collateral; a release ends it.

USPTO bulk data: PatentsView granted patents, disambiguated (PVGPATDIS) for patents, assignees, inventors, places and CPC categories; the USPTO Patent Assignment Dataset (ECORSEXC) for assignments and security interests. Patents filed in the last 20 years. No claims or full text. Links to other records are by name (and state): EXACT means the identical full name and state; FUZZY means a looser name match, with the confidence shown.