bookmark_borderbookmark
Stay organized with collections
Save and categorize content based on your preferences.
plat_iosplat_android
With ML Kit's on-device object detection and tracking API, you can localize
and track in real time the most prominent objects in an image or live camera
feed. You can also optionally classify detected objects into one of several
general categories.
Object detection and tracking with coarse classification is useful for building
live visual search experiences. Because object detection and tracking happens
quickly and completely on the device, it works well as the front end of a longer
visual search pipeline. After you detect and filter objects, you can pass them
to a cloud backend, such as Cloud Vision Product Search,
or to a custom model, such as one you trained using
AutoML Vision Edge.
Detect objects and get their location in the image. Track objects across
images.
Optimized on-device model
The object detection and tracking model is optimized for mobile devices
and intended for use in real-time applications, even on lower-end
devices.
Prominent object detection
Automatically determine the most prominent object in an image.
Coarse classification
Classify objects into broad categories, which you can use to filter out
objects you're not interested in. The following categories are supported:
home goods, fashion goods, food, plants, places, and unknown.
Example results
Tracking the most prominent object across images
Tracking ID
0
Bounds
(95, 45), (496, 45), (496, 240), (95, 240)
Category
PLACE
Classification confidence
0.9296875
Tracking ID
0
Bounds
(84, 46), (478, 46), (478, 247), (84, 247)
Category
PLACE
Classification confidence
0.8710938
Tracking ID
0
Bounds
(53, 45), (519, 45), (519, 240), (53, 240)
Category
PLACE
Classification confidence
0.8828125
Photo: Christian Ferrer [CC BY-SA 4.0]
Multiple objects in a static image
Object 0
Bounds
(1, 97), (332, 97), (332, 332), (1, 332)
Category
FASHION_GOOD
Classification confidence
0.95703125
Object 1
Bounds
(186, 80), (337, 80), (337, 226), (186, 226)
Category
FASHION_GOOD
Classification confidence
0.84375
Object 2
Bounds
(296, 80), (472, 80), (472, 388), (296, 388)
Category
FASHION_GOOD
Classification confidence
0.94921875
Object 3
Bounds
(439, 83), (615, 83), (615, 306), (439, 306)
Category
FASHION_GOOD
Classification confidence
0.9375
Was this helpful?
Recommended for you
About these recommendations
These recommendations help you find the content you are looking for. They may be based on the page you’re currently viewing and your account’s saved web and app activity.
ML Kit for Firebase provided ready-to-use ML solutions for app developers. New apps should use the standalone ML Kit library for on-device ML and Firebase ML for cloud-based ML.
ML Kit for Firebase provided ready-to-use ML solutions for app developers. New apps should use the standalone ML Kit library for on-device ML and Firebase ML for cloud-based ML.
ML Kit for Firebase provided ready-to-use ML solutions for app developers. New apps should use the standalone ML Kit library for on-device ML and Firebase ML for cloud-based ML.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Missing the information I need","missingTheInformationINeed","thumb-down"],["Too complicated / too many steps","tooComplicatedTooManySteps","thumb-down"],["Out of date","outOfDate","thumb-down"],["Samples / code issue","samplesCodeIssue","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2025-02-20 UTC."],[],[]]