Statistical methods for fine-grained retail product recognition

Baz, İpek (2019) Statistical methods for fine-grained retail product recognition. [Thesis]

[thumbnail of 10283427_İpekBaz.pdf] PDF

Download (39MB)


In recent years, computer vision has become a major instrument in automating retail processes with emerging smart applications such as shopper assistance, visual product search (e.g., Google Lens), no-checkout stores (e.g., Amazon Go), real-time inventory tracking, out-of-stock detection, and shelf execution. At the core of these applications lies the problem of product recognition, which poses a variety of new challenges in contrast to generic object recognition. Product recognition is a special instance of fine-grained classification. Considering the sheer diversity of packaged goods in a typical hypermarket, we are confronted with up to tens of thousands of classes, which, particularly if under the same product brand, tend to have only minute visual differences in shape, packaging texture, metric size, etc., making them very difficult to discriminate from one another. Another challenge is the limited number of available datasets, which either have only a few training examples per class that are taken under ideal studio conditions, hence requiring cross-dataset generalization, or are captured from the shelf in an actual retail environment and thus suffer from issues like blur, low resolution, occlusions, unexpected backgrounds, etc. Thus, an effective product classification system requires substantially more information in addition to the knowledge obtained from product images alone. In this thesis, we propose statistical methods for a fine-grained retail product recognition. In our first framework, we propose a novel context-aware hybrid classification system for the fine-grained retail product recognition problem. In the second framework, state-of-the-art convolutional neural networks are explored and adapted to fine-grained recognition of products. The third framework, which is the most significant contribution of this thesis, presents a new approach for fine-grained classification of retail products that learns and exploits statistical context information about likely product arrangements on shelves, incorporates visual hierarchies across brands, and returns recognition results as "confidence sets" that are guaranteed to contain the true class at a given confidence level
Item Type: Thesis
Uncontrolled Keywords: Fine-grained classification. -- Retail product classification. -- Confidence sets. -- Context-aware classification. -- Hidden markov models. -- Conditional random fields. -- Hierarchical classification. -- Convolutional neural networks. -- İnce taneli sınıflandırma. -- Perakende ürün sınıflandırması. -- Güven kümeleri. -- Bağlam duyarlı sınıflandırma. -- Saklı Markov Modeli. -- Koşullu rasgele alanlar. -- Hiyerarşik sınıflandırma. -- Konvolüsyonel sinir ağları.
Subjects: T Technology > TK Electrical engineering. Electronics Nuclear engineering > TK7800-8360 Electronics
Divisions: Faculty of Engineering and Natural Sciences > Academic programs > Electronics
Faculty of Engineering and Natural Sciences
Depositing User: IC-Cataloging
Date Deposited: 26 Sep 2019 13:48
Last Modified: 26 Apr 2022 10:31

Actions (login required)

View Item
View Item