Patents

US 12699877 B2: Network-centric architecture and algorithms to accelerate distributed training of neural networks

Granted
2026-08-04
Filed
2019-10-11 application 17284418
Type
Utility · 16 claims
Elsewhere
Google Patents ↗ · USPTO patent document ↗ · USPTO Patent Center record ↗

Abstract

A distributed network includes a first group of computing devices. Each computing device is to be coupled to two neighbor computing devices of the first group of computing device and is to: (i) aggregate gradient values received from a first neighbor computing device with local gradient values to generate a partial aggregate of gradient values that are to train a neural network model; (ii) transfer the partial aggregate of gradient values to a second neighbor computing device; and repeat (i) and (ii) until a first aggregate of gradient values from the first group of computing devices is buffered at a first computing device of the first group of computing devices. The first computing device is to transfer the first aggregate of gradient values to a second group of computing devices of the distributed network for further aggregation.

Source: PTBLXML, file of 2026-08-04 (ipgb20260804.xml).

Assignees

AssigneeTypePlaceAlso on furp.orgSource
Board of Trustees of the University of Illinois 1,493 patentsUS company or organizationUrbana, ILTHE BOARD OF TRUSTEES OF THE UNIVERSITY OF ILLINOIS Nonprofit EXACT high confidence: identical full name and statePTBLXML, file of 2026-08-04

Inventors

InventorPlacePatentsPerson pageSource
Nam Sung KimChampaign, IL70PTBLXML, file of 2026-08-04
Youjie LiChangsha, CN4PTBLXML, file of 2026-08-04
Alexander Gerhard SchwingChampaign, ILPTBLXML, file of 2026-08-04

CPC categories

SubclassCategoryFirst groupSource
G06NComputing arrangements based on specific computational modelsG06N3/045PTBLXML, file of 2026-08-04
H03MCoding; decoding; code conversion in generalH03M7/702PTBLXML, file of 2026-08-04

Cooperative Patent Classification, as currently assigned (one row per subclass).

Assignments and security interests

RecordedWhatFromToReel/frameSource
2026-04-10Correction
Corrective assignment to correct the spelling of inventor 2's first name from youlie to youjie previously recorded on reel 55948 frame 561. assignor(s) hereby confirms the assignment.
KIM, NAM SUNG signed 2019-10-04
LI, YOUJIE signed 2019-10-03
SCHWING, ALEXANDER GERHARD signed 2019-10-01
THE BOARD OF TRUSTEES OF THE UNIVERSITY OF ILLINOIS URBANA, IL75387/785PASDL, file of 2026-09-23

Documents recorded with the USPTO Assignment Recordation Branch that list this patent. A security interest is a lender’s claim on the patent as collateral; a release ends it.

USPTO bulk data: PatentsView granted patents, disambiguated (PVGPATDIS) for patents, assignees, inventors, places and CPC categories; the USPTO Patent Assignment Dataset (ECORSEXC) for assignments and security interests. Patents filed in the last 20 years. No claims or full text. Links to other records are by name (and state): EXACT means the identical full name and state; FUZZY means a looser name match, with the confidence shown.