Patents
US 12175708 B2: Systems and methods for self-supervised learning of camera intrinsic parameters from a sequence of images
- Granted
- 2024-12-24
- Filed
- 2022-03-11 application 17692357
- Type
- Utility · 20 claims
- Elsewhere
- Google Patents ↗ · USPTO patent document ↗ · USPTO Patent Center record ↗
Abstract
Systems and methods described herein relate to self-supervised learning of camera intrinsic parameters from a sequence of images. One embodiment produces a depth map from a current image frame captured by a camera; generates a point cloud from the depth map using a differentiable unprojection operation; produces a camera pose estimate from the current image frame and a context image frame; produces a warped point cloud based on the camera pose estimate; generates a warped image frame from the warped point cloud using a differentiable projection operation; compares the warped image frame with the context image frame to produce a self-supervised photometric loss; updates a set of estimated camera intrinsic parameters on a per-image-sequence basis using one or more gradients from the self-supervised photometric loss; and generates, based on a converged set of learned camera intrinsic parameters, a rectified image frame from an image frame captured by the camera.
Source: PVGPATDIS, file of 2026-04-10 (ipg241224.xml).
Assignees
| Assignee | Type | Place | Also on furp.org | Source |
|---|---|---|---|---|
| TOYOTA RESEARCH INSTITUTE, INC. 875 patents | US company or organization | Los Altos, CA | PVGPATDIS, file of 2026-04-10 | |
| Toyota Technological Institute at Chicago 7 patents | US company or organization | Chicago, IL | Toyota Technological Institute at Chicago College or university EXACT high confidence: identical full name and state TOYOTA TECHNOLOGICAL INSTITUTE AT CHICAGO Nonprofit EXACT high confidence: identical full name and state | PVGPATDIS, file of 2026-04-10 |
Inventors
| Inventor | Place | Patents | Person page | Source |
|---|---|---|---|---|
| Vitor Guizilini | Santa Clara, CA | 101 | PVGPATDIS, file of 2026-04-10 | |
| Adrien David Gaidon | Mountain View, CA | 146 | PVGPATDIS, file of 2026-04-10 | |
| Rares A. Ambrus | San Francisco, CA | 93 | PVGPATDIS, file of 2026-04-10 | |
| Igor Vasiljevic | Fort Lauderdale, FL | 26 | PVGPATDIS, file of 2026-04-10 | |
| Jiading Fang | Chicago, IL | 8 | PVGPATDIS, file of 2026-04-10 | |
| Gregory Shakhnarovich | Chicago, IL | 8 | Person page FUZZY high confidence | PVGPATDIS, file of 2026-04-10 |
| Matthew R. Walter | Chicago, IL | 4 | PVGPATDIS, file of 2026-04-10 |
CPC categories
| Subclass | Category | First group | Source |
|---|---|---|---|
| G06T | Image data processing or generation, in general | G06T7/80 | PVGPATDIS, file of 2026-04-10 |
| B60W | Conjoint control of vehicle sub-units of different type or different function; control systems specially adapted for hybrid vehicles; road vehicle drive control systems for purposes not related to the control of a particular sub-unit | B60W60/001 | PVGPATDIS, file of 2026-04-10 |
| B64C | Aeroplanes; helicopters | B64C39/024 | PVGPATDIS, file of 2026-04-10 |
| B64U | Unmanned aerial vehicles [uav]; equipment therefor | B64U2201/00 | PVGPATDIS, file of 2026-04-10 |
| G05D | Systems for controlling or regulating non-electric variables | G05D1/0246 | PVGPATDIS, file of 2026-04-10 |
| H04N | Pictorial communication, e.g. television | H04N5/2628 | PVGPATDIS, file of 2026-04-10 |
Cooperative Patent Classification, as currently assigned (one row per subclass).
Assignments and security interests
| Recorded | What | From | To | Reel/frame | Source |
|---|---|---|---|---|---|
| 2024-12-31 | Assignment Assignment of assignor's interest | TOYOTA RESEARCH INSTITUTE, INC. signed 2024-12-19 | TOYOTA JIDOSHA KABUSHIKI KAISHA TOYOTA-SHI AICHI-KEN | 69706/498 | ECORSEXC, file of 2026-09-25 |
| 2022-03-24 | Assignment Assignment of assignor's interest | FANG, JIADING signed 2022-02-22 SHAKHNAROVICH, GREGORY signed 2022-02-28 WALTER, MATTHEW R. signed 2022-03-10 | TOYOTA TECHNICAL INSTITUTE AT CHICAGO CHICAGO, IL | 59385/179 | ECORSEXC, file of 2026-09-25 |
| 2022-03-24 | Assignment Assignment of assignor's interest | GUIZILINI, VITOR signed 2022-02-14 AMBRUS, RARES A. signed 2022-02-16 VASILJEVIC, IGOR signed 2022-02-16 GAIDON, ADRIEN DAVID signed 2022-02-18 | TOYOTA RESEARCH INSTITUTE, INC. LOS ALTOS, CA | 59385/172 | ECORSEXC, file of 2026-09-25 |
Documents recorded with the USPTO Assignment Recordation Branch that list this patent. A security interest is a lender’s claim on the patent as collateral; a release ends it.
USPTO bulk data: PatentsView granted patents, disambiguated (PVGPATDIS) for patents, assignees, inventors, places and CPC categories; the USPTO Patent Assignment Dataset (ECORSEXC) for assignments and security interests. Patents filed in the last 20 years. No claims or full text. Links to other records are by name (and state): EXACT means the identical full name and state; FUZZY means a looser name match, with the confidence shown.