Patents
US 12699877 B2: Network-centric architecture and algorithms to accelerate distributed training of neural networks
- Granted
- 2026-08-04
- Filed
- 2019-10-11 application 17284418
- Type
- Utility · 16 claims
- Elsewhere
- Google Patents ↗ · USPTO patent document ↗ · USPTO Patent Center record ↗
Abstract
A distributed network includes a first group of computing devices. Each computing device is to be coupled to two neighbor computing devices of the first group of computing device and is to: (i) aggregate gradient values received from a first neighbor computing device with local gradient values to generate a partial aggregate of gradient values that are to train a neural network model; (ii) transfer the partial aggregate of gradient values to a second neighbor computing device; and repeat (i) and (ii) until a first aggregate of gradient values from the first group of computing devices is buffered at a first computing device of the first group of computing devices. The first computing device is to transfer the first aggregate of gradient values to a second group of computing devices of the distributed network for further aggregation.
Source: PTBLXML, file of 2026-08-04 (ipgb20260804.xml).
Assignees
| Assignee | Type | Place | Also on furp.org | Source |
|---|---|---|---|---|
| Board of Trustees of the University of Illinois 1,493 patents | US company or organization | Urbana, IL | THE BOARD OF TRUSTEES OF THE UNIVERSITY OF ILLINOIS Nonprofit EXACT high confidence: identical full name and state | PTBLXML, file of 2026-08-04 |
Inventors
| Inventor | Place | Patents | Person page | Source |
|---|---|---|---|---|
| Nam Sung Kim | Champaign, IL | 70 | PTBLXML, file of 2026-08-04 | |
| Youjie Li | Changsha, CN | 4 | PTBLXML, file of 2026-08-04 | |
| Alexander Gerhard Schwing | Champaign, IL | PTBLXML, file of 2026-08-04 |
CPC categories
| Subclass | Category | First group | Source |
|---|---|---|---|
| G06N | Computing arrangements based on specific computational models | G06N3/045 | PTBLXML, file of 2026-08-04 |
| H03M | Coding; decoding; code conversion in general | H03M7/702 | PTBLXML, file of 2026-08-04 |
Cooperative Patent Classification, as currently assigned (one row per subclass).
Assignments and security interests
| Recorded | What | From | To | Reel/frame | Source |
|---|---|---|---|---|---|
| 2026-04-10 | Correction Corrective assignment to correct the spelling of inventor 2's first name from youlie to youjie previously recorded on reel 55948 frame 561. assignor(s) hereby confirms the assignment. | KIM, NAM SUNG signed 2019-10-04 LI, YOUJIE signed 2019-10-03 SCHWING, ALEXANDER GERHARD signed 2019-10-01 | THE BOARD OF TRUSTEES OF THE UNIVERSITY OF ILLINOIS URBANA, IL | 75387/785 | PASDL, file of 2026-09-23 |
Documents recorded with the USPTO Assignment Recordation Branch that list this patent. A security interest is a lender’s claim on the patent as collateral; a release ends it.
USPTO bulk data: PatentsView granted patents, disambiguated (PVGPATDIS) for patents, assignees, inventors, places and CPC categories; the USPTO Patent Assignment Dataset (ECORSEXC) for assignments and security interests. Patents filed in the last 20 years. No claims or full text. Links to other records are by name (and state): EXACT means the identical full name and state; FUZZY means a looser name match, with the confidence shown.