Patents

US 12175708 B2: Systems and methods for self-supervised learning of camera intrinsic parameters from a sequence of images

Granted
2024-12-24
Filed
2022-03-11 application 17692357
Type
Utility · 20 claims
Elsewhere
Google Patents ↗ · USPTO patent document ↗ · USPTO Patent Center record ↗

Abstract

Systems and methods described herein relate to self-supervised learning of camera intrinsic parameters from a sequence of images. One embodiment produces a depth map from a current image frame captured by a camera; generates a point cloud from the depth map using a differentiable unprojection operation; produces a camera pose estimate from the current image frame and a context image frame; produces a warped point cloud based on the camera pose estimate; generates a warped image frame from the warped point cloud using a differentiable projection operation; compares the warped image frame with the context image frame to produce a self-supervised photometric loss; updates a set of estimated camera intrinsic parameters on a per-image-sequence basis using one or more gradients from the self-supervised photometric loss; and generates, based on a converged set of learned camera intrinsic parameters, a rectified image frame from an image frame captured by the camera.

Source: PVGPATDIS, file of 2026-04-10 (ipg241224.xml).

Assignees

AssigneeTypePlaceAlso on furp.orgSource
TOYOTA RESEARCH INSTITUTE, INC. 875 patentsUS company or organizationLos Altos, CAPVGPATDIS, file of 2026-04-10
Toyota Technological Institute at Chicago 7 patentsUS company or organizationChicago, ILToyota Technological Institute at Chicago College or university EXACT high confidence: identical full name and state
TOYOTA TECHNOLOGICAL INSTITUTE AT CHICAGO Nonprofit EXACT high confidence: identical full name and state
PVGPATDIS, file of 2026-04-10

Inventors

InventorPlacePatentsPerson pageSource
Vitor GuiziliniSanta Clara, CA101PVGPATDIS, file of 2026-04-10
Adrien David GaidonMountain View, CA146PVGPATDIS, file of 2026-04-10
Rares A. AmbrusSan Francisco, CA93PVGPATDIS, file of 2026-04-10
Igor VasiljevicFort Lauderdale, FL26PVGPATDIS, file of 2026-04-10
Jiading FangChicago, IL8PVGPATDIS, file of 2026-04-10
Gregory ShakhnarovichChicago, IL8Person page FUZZY high confidencePVGPATDIS, file of 2026-04-10
Matthew R. WalterChicago, IL4PVGPATDIS, file of 2026-04-10

CPC categories

SubclassCategoryFirst groupSource
G06TImage data processing or generation, in generalG06T7/80PVGPATDIS, file of 2026-04-10
B60WConjoint control of vehicle sub-units of different type or different function; control systems specially adapted for hybrid vehicles; road vehicle drive control systems for purposes not related to the control of a particular sub-unitB60W60/001PVGPATDIS, file of 2026-04-10
B64CAeroplanes; helicoptersB64C39/024PVGPATDIS, file of 2026-04-10
B64UUnmanned aerial vehicles [uav]; equipment thereforB64U2201/00PVGPATDIS, file of 2026-04-10
G05DSystems for controlling or regulating non-electric variablesG05D1/0246PVGPATDIS, file of 2026-04-10
H04NPictorial communication, e.g. televisionH04N5/2628PVGPATDIS, file of 2026-04-10

Cooperative Patent Classification, as currently assigned (one row per subclass).

Assignments and security interests

RecordedWhatFromToReel/frameSource
2024-12-31Assignment
Assignment of assignor's interest
TOYOTA RESEARCH INSTITUTE, INC. signed 2024-12-19TOYOTA JIDOSHA KABUSHIKI KAISHA TOYOTA-SHI AICHI-KEN69706/498ECORSEXC, file of 2026-09-25
2022-03-24Assignment
Assignment of assignor's interest
FANG, JIADING signed 2022-02-22
SHAKHNAROVICH, GREGORY signed 2022-02-28
WALTER, MATTHEW R. signed 2022-03-10
TOYOTA TECHNICAL INSTITUTE AT CHICAGO CHICAGO, IL59385/179ECORSEXC, file of 2026-09-25
2022-03-24Assignment
Assignment of assignor's interest
GUIZILINI, VITOR signed 2022-02-14
AMBRUS, RARES A. signed 2022-02-16
VASILJEVIC, IGOR signed 2022-02-16
GAIDON, ADRIEN DAVID signed 2022-02-18
TOYOTA RESEARCH INSTITUTE, INC. LOS ALTOS, CA59385/172ECORSEXC, file of 2026-09-25

Documents recorded with the USPTO Assignment Recordation Branch that list this patent. A security interest is a lender’s claim on the patent as collateral; a release ends it.

USPTO bulk data: PatentsView granted patents, disambiguated (PVGPATDIS) for patents, assignees, inventors, places and CPC categories; the USPTO Patent Assignment Dataset (ECORSEXC) for assignments and security interests. Patents filed in the last 20 years. No claims or full text. Links to other records are by name (and state): EXACT means the identical full name and state; FUZZY means a looser name match, with the confidence shown.