Patents
US 10217120 B1: Method and system for in-store shopper behavior analysis with multi-modal sensor fusion
- Granted
- 2019-02-26
- Filed
- 2015-04-21 application 14692446
- Type
- Utility · 44 claims
- Elsewhere
- Google Patents ↗ · USPTO patent document ↗ · USPTO Patent Center record ↗
Abstract
The present invention provides a comprehensive method for automatically and unobtrusively analyzing the in-store behavior of people visiting a physical space using a multi-modal fusion based on multiple types of sensors. The types of sensors employed may include cameras for capturing a plurality of images and mobile signal sensors for capturing a plurality of Wi-Fi signals. The present invention integrates the plurality of input sensor measurements to reliably and persistently track the people's physical attributes and detect the people's interactions with retail elements. The physical and contextual attributes collected from the processed shopper tracks includes the motion dynamics changes triggered by an implicit and explicit interaction to a retail element, comprising the behavior information for the trip of the people. The present invention integrates point-of-sale transaction data with the shopper behavior by finding and associating the transaction data that corresponds to a shopper trajectory and fusing them to generate a complete an intermediate representation of a shopper trip data, called a TripVector. The shopper behavior analyses are carried out based on the extracted TripVector. The analyzed behavior information for the shopper trips yields exemplary behavior analysis comprising map generation as visualization of the behavior, quantitative shopper metric derivation in multiple scales (e.g., store-wide and category-level) including path-to-purchase shopper metrics (e.g., traffic distribution, shopping action distribution, buying action distribution, conversion funnel), category dynamics (e.g., dominant path, category correlation, category sequence). The present invention includes a set of derived methods for different sensor configurations.
Source: PVGPATDIS, file of 2026-04-10 (ipg190226.xml).
Assignees
| Assignee | Type | Place | Also on furp.org | Source |
|---|---|---|---|---|
| VideoMining Corporation 54 patents | US company or organization | State College, PA | Videomining Corporation State business registration EXACT high confidence: identical full name and state VIDEOMINING CORP Form D issuer FUZZY medium confidence: same name (legal endings aside) and state | PVGPATDIS, file of 2026-04-10 |
Inventors
| Inventor | Place | Patents | Person page | Source |
|---|---|---|---|---|
| Joonhwa Shin | State College, PA | 15 | PVGPATDIS, file of 2026-04-10 | |
| Rajeev Sharma | State College, PA | 83 | PVGPATDIS, file of 2026-04-10 |
CPC categories
| Subclass | Category | First group | Source |
|---|---|---|---|
| G06Q | Information and communication technology [ict] specially adapted for administrative, commercial, financial, managerial or supervisory purposes; systems or methods specially adapted for administrative, commercial, financial, managerial or supervisory purposes, not otherwise provided for | G06Q30/0201 | PVGPATDIS, file of 2026-04-10 |
| G01S | Radio direction-finding; radio navigation; determining distance or velocity by use of radio waves; locating or presence-detecting by use of the reflection or reradiation of radio waves; analogous arrangements using other waves | G01S5/0252 | PVGPATDIS, file of 2026-04-10 |
| H04N | Pictorial communication, e.g. television | H04N17/002 | PVGPATDIS, file of 2026-04-10 |
| H04W | Wireless communication networks | H04W4/02 | PVGPATDIS, file of 2026-04-10 |
Cooperative Patent Classification, as currently assigned (one row per subclass).
Assignments and security interests
| Recorded | What | From | To | Reel/frame | Source |
|---|---|---|---|---|---|
| 2023-10-05 | Release of security interest Release of security interest | VIDEOMINING CORPORATION signed 2023-09-26 VIDEOMINING, LLC signed 2023-09-26 | WHITE OAK YIELD SPECTRUM PARALELL FUND, LP SAN FRANCISCO, CA WHITE OAK YIELD SPECTRUM REVOLVER FUND SCSP SAN FRANCISCO, CA | 65156/157 | ECORSEXC, file of 2026-09-25 |
| 2023-09-08 | Release of security interest Release of security interest | ENTERPRISE BANK signed 2023-09-05 | VIDEOMINING CORPORATION STATE COLLEGE, PA VIDEOMINING, LLC FKA VMC ACQ., LLC STATE COLLEGE, PA | 64842/66 | ECORSEXC, file of 2026-09-25 |
| 2022-02-07 | Name change Change of name | VMC ACQ., LLC signed 2022-01-18 | VIDEOMINING, LLC STATE COLLEGE, PA | 58959/406 | ECORSEXC, file of 2026-09-25 |
| 2022-02-07 | Name change Change of name | VMC ACQ., LLC signed 2022-01-18 | VIDEOMINING, LLC STATE COLLEGE, PA | 58959/397 | ECORSEXC, file of 2026-09-25 |
| 2022-02-07 | Name change Change of name | VMC ACQ., LLC signed 2022-01-18 | VIDEOMINING, LLC STATE COLLEGE, PA | 58957/67 | ECORSEXC, file of 2026-09-25 |
| 2022-02-01 | Name change Change of name | VMC ACQ., LLC signed 2022-01-11 | VIDEOMINING, LLC STATE COLLEGE, PA | 58922/571 | ECORSEXC, file of 2026-09-25 |
| 2021-12-21 | Assignment Assignment of assignor's interest | VIDEOMINING CORPORATION signed 2021-05-26 | VMC ACQ., LLC STATE COLLEGE, PA | 58552/34 | ECORSEXC, file of 2026-09-25 |
| 2021-12-20 | Security interest Security interest Security interest | VIDEOMINING CORPORATION signed 2021-12-10 VMC ACQ., LLC signed 2021-12-10 | ENTERPRISE BANK ALLISON PARK, PA | 58430/273 | ECORSEXC, file of 2026-09-25 |
| 2019-04-12 | Security interest Security interest Security interest | VIDEOMINING CORPORATION signed 2018-10-01 | HIRATA, RICHARD STATE COLLEGE, PA | 48876/351 | ECORSEXC, file of 2026-09-25 |
| 2019-04-12 | Security interest Security interest Security interest | VIDEOMINING CORPORATION signed 2018-10-01 | HARI, DILIP BELLEFONTE, PA | 48874/529 | ECORSEXC, file of 2026-09-25 |
| 2017-08-03 | Security interest Security interest Security interest | VIDEOMINING CORPORATION signed 2017-07-27 | FEDERAL NATIONAL PAYABLES, INC. D/B/A/ FEDERAL NATIONAL COMMERCIAL CREDIT BETHESDA, MD | 43430/818 | ECORSEXC, file of 2026-09-25 |
| 2017-01-25 | Release of security interest Release of security interest | AMERISERV FINANCIAL BANK signed 2017-01-19 | VIDEOMINING CORPORATION STATE COLLEGE, PA | 41082/41 | ECORSEXC, file of 2026-09-25 |
| 2017-01-13 | Security interest Security interest Security interest | VIDEOMINING CORPORATION signed 2017-01-12 | ENTERPRISE BANK ALLISON PARK, PA | 40998/745 | ECORSEXC, file of 2026-09-25 |
| 2016-05-31 | Security interest Security interest Security interest | VIDEOMINING CORPORATION signed 2016-05-19 | AMERISERV FINANCIAL BANK JOHNSTOWN, PA | 38751/889 | ECORSEXC, file of 2026-09-25 |
| 2015-04-21 | Assignment Assignment of assignor's interest | SHARMA, RAJEEV signed 2015-04-21 SHIN, JOONHWA signed 2015-04-21 | VIDEOMINING CORPORATION STATE COLLEGE, PA | 35475/650 | ECORSEXC, file of 2026-09-25 |
Documents recorded with the USPTO Assignment Recordation Branch that list this patent. A security interest is a lender’s claim on the patent as collateral; a release ends it.
USPTO bulk data: PatentsView granted patents, disambiguated (PVGPATDIS) for patents, assignees, inventors, places and CPC categories; the USPTO Patent Assignment Dataset (ECORSEXC) for assignments and security interests. Patents filed in the last 20 years. No claims or full text. Links to other records are by name (and state): EXACT means the identical full name and state; FUZZY means a looser name match, with the confidence shown.