Abstract: The paper presents a smart camera aimed at security and law enforcement applications for intelligent transportation systems. An extended background is presented first as a scholar literature review. The smart camera components and their capabilities for automatic detection and recognition of selected parameters of cars, as well as different aspects of the system efficiency, are described and discussed in detail in subsequent sections. Smart features of make and model recognition (MMR), license plate recognition (LPR) and color recognition (CR) are highlighted as the main benefits of the system. Their implementations, flowcharts and recognition rates are described, discussed and finally reported in detail. In addition to MMR, three different approaches, referred to as bag-of-features, scalable vocabulary tree and pyramid match, are also considered. The conclusion includes a discussion of the smart camera system efficiency as a whole, with an insight into potential future improvements.
B I B L I O G R A F I A1. Shi Y. LS (2006) Smart Cameras: A Review. CCTV Focus.
2. Stahlschmidt C, Gavriilidis A, Velten J, Kummert A (2013) People Detection and Tracking from a Top-View Position Using a Time-of-Flight Camera. Multimedia Communications, Services and Security, Mcss 2013 368:213-223
3. Bulan O, Loce RP, Wu W, Wang Y, Bernal EA, Fan Z (2013) Video-based real-time on-street parking occupancy detection system. Journal of Electronic Imaging 22 (4). doi:10.1117/1.jei.22.4.041109
4. SaLsA. http://www.salsa-autonomik.de/, Viewed 15 July 2015.
5. Janowski L, Kozlowski P, Baran R, Romaniak P, Glowacz A, Rusc T (2014) Quality assessment for a visual and automatic license plate recognition. Multimedia Tools and Applications 68 (1):23-40. doi:10.1007/s11042-012-1199-5
6. Psyllos A, Anagnostopoulos CN, Kayafas E (2011) Vehicle model recognition from frontal view image measurements. Computer Standards & Interfaces 33 (2):142-151. doi:10.1016/j.csi.2010.06.005
7. Insigma. http://kt.agh.edu.pl/en/projekt/294, Viewed 15 July 2015.
8. Szeto WY (2014) Dynamic Modeling for Intelligent Transportation System Applications. Journal of Intelligent Transportation Systems 18 (4):323-326. doi:10.1080/15472450.2013.834770
9. lex.europa.eu (2010) DIRECTIVE 2010/40/EU.
10. Loce RP, Bernal EA, Wu WC, Bala R (2013) Computer vision in roadway transportation systems: a survey. Journal of Electronic Imaging 22 (4):24. doi:10.1117/1.jei.22.4.041121
11. Bulan O, Bernal EA, Loce RP (2013) Efficient processing of transportation surveillance videos in the compressed domain. Journal of Electronic Imaging 22 (4). doi:10.1117/1.jei.22.4.041116
12. Fathy M, Siyal MY (1995) An image detection technique based on morphological edge detection and background differencing for real-time traffic analysis. Pattern Recognition Letters 16 (12):1321-1330. doi:10.1016/0167-8655(95)00081-x
13. Caliendo C, Guida M (2012) Microsimulation Approach for Predicting Crashes at Unsignalized Intersections Using Traffic Conflicts. Journal of Transportation Engineering-Asce 138 (12):1453-1467. doi:10.1061/(asce)te.1943-5436.0000473
14. Huang Y-P, Chen C-H, Chang Y-T, Sandnes FE (2009) An intelligent strategy for checking the annual inspection status of motorcycles based on license plate recognition. Expert Systems with Applications 36 (5):9260-9267. doi:10.1016/j.eswa.2008.12.006
15. Chang SL, Chen LS, Chung YC, Chen SW (2004) Automatic license plate recognition. IEEE Transactions on Intelligent Transportation Systems 5 (1):42-53. doi:10.1109/tits.2004.825086
16. Anagnostopoulos CNE, Anagnostopoulos IE, Loumos V, Kayafas E (2006) A license plate-recognition algorithm for intelligent transportation system applications. IEEE Transactions on Intelligent Transportation Systems 7 (3):377-392. doi:10.1109/tits.2006.880641
17. Shapiro V, Gluhchev G, Dimov D (2006) Towards a multinational car license plate recognition system. Machine Vision and Applications 17 (3):173-183. doi:10.1007/s00138-006-0023-5
18. Jin L, Xian H, Bie J, Sun Y, Hou H, Niu Q (2012) License Plate Recognition Algorithm for Passenger Cars in Chinese Residential Areas. Sensors 12 (6):8355-8370. doi:10.3390/s120608355
19. Pan J, Yuan Z (2008) Research on License Plate Detection Based on Wavelet. Advanced Intelligent Computing Theories and Applications, Proceedings: with Aspects of Contemporary Intelligent Computing Techniques 15:440-446
20. Arulmozhi K, Perumal AS, Sanooj P, Nallaperumal K, IEEE (2012) Application of Top Hat Transform Technique on Indian License Plate Image Localization. 2012 IEEE International Conference on Computational Intelligence and Computing Research (Iccic):708-711
21. Jiao J, Ye Q, Huang Q (2009) A configurable method for multi-style license plate recognition. Pattern Recognition 42 (3):358-369. doi:10.1016/j.patcog.2008.08.016
22. Vishwanath N, Somasundaram S, Ravi MRR, Nallaperumal NK, IEEE (2012) Connected Component Analysis for Indian License Plate Infra-Red and Color Image Character Segmentation. 2012 IEEE International Conference on Computational Intelligence and Computing Research (Iccic):743-746
23. Zhai B-F, Xu E, Wang Q, Li Y (2011) Characters Edge Detection Method of Vehicle License Tag Based on Canny Operator. 2011 Second International Conference on Education and Sports Education.
24. Wang A, Liu X, IEEE (2012) Vehicle License Plate Location Based on Improved Roberts Operator and Mathematical Morphology. Proceedings of the 2012 Second International Conference on Instrumentation & Measurement, Computer, Communication and Control (Imccc 2012):995-998. doi:10.1109/imccc.2012.237
25. Chen LH, Hung YL, Su CW (2013) INTEGRATION OF KEYPOINTS AND EDGES FOR IMAGE RETRIEVAL. International Journal of Pattern Recognition and Artificial Intelligence 27 (8). doi:10.1142/s0218001413550136
26. Wang Y-R, Lin W-H, Horng S-J (2009) Fast License Plate Localization Using Discrete Wavelet Transform. Algorithms and Architectures for Parallel Processing, Proceedings 5574:408-415
27. Hong Won Ju, Kim Min Woo, Oh, Il-Seok (2013) Learning-based Detection of License Plate using SIFT and Neural Network, The Institute of Electronics Engineers of Korea, Volume.50, Issue.8, 2013, Page 187-195 http://dx.doi.org/10.5573/ieek.2013.50.8.187
28. Gorzalczany MB, Rudzinski F (2006) Cluster analysis via dynamic self-organizing neural networks. In: Rutkowski L, Tadeusiewicz R, Zadeh LA, Zurada J (eds) Artificial Intelligence and Soft Computing - Icaisc 2006, Proceedings, vol 4029. Lecture Notes in Computer Science. pp 593-602
29. Arulmozhi K, Perumal AS, Priyadarsini TCS, Nallaperumal K, IEEE (2012) Image Refinement Using Skew Angle Detection and Correction for Indian License Plates. 2012 IEEE International Conference on Computational Intelligence and Computing Research (Iccic):718-721
30. Ju Z, Wang P (2012) License Plate Image Skew Correction Algorithm Based on Geometric Constraint. 1-4,
31. Wen Y, Lu Y, Yan J, Zhou Z, von Deneen KM, Shi P (2011) An Algorithm for License Plate Recognition Applied to Intelligent Transportation System. IEEE Transactions on Intelligent Transportation Systems 12 (3):830-845. doi:10.1109/tits.2011.2114346
32. Ren C, Song J (2013) A Character Segmentation Method Based on Character Structural Features and Projection. Fifth International Conference on Digital Image Processing (Icdip 2013) 8878. doi:10.1117/12.2030579
33. Yoon Y, Ban K-D, Yoon H, Kim J, IEEE (2012) Blob Detection and Filtering for Character Segmentation of License Plates. 2012 IEEE 14th International Workshop on Multimedia Signal Processing (Mmsp):349-353
34. Yoon Y, Ban K-D, Yoon H, Lee J, Kim J (2013) Best Combination of Binarization Methods for License Plate Character Segmentation. Etri Journal 35 (3):491-500. doi:10.4218/etrij.13.0112.0545
35. Zhang Y, Zha Z, Bai L (2013) A License Plate Character Segmentation Method Based on Character Contour and Template Matching. Measurement Technology and Engineering Researches in Industry, Pts 1-3 333-335:974-979. doi:10.4028/www.scientific.net/AMM.333-335.974
36. Ghazal M, Hajjdiab H, IEEE (2013) License Plate Automatic Detection and Recognition Using Level Sets and Neural Networks. 2013 First International Conference on Communications Signal Processing, and Their Applications (Iccspa'13)
37. Ozturk F, Ozen F (2012) A New License Plate Recognition System Based on Probabilistic Neural Networks. First World Conference on Innovation and Computer Sciences (Insode 2011) 1:124-128. doi:10.1016/j.protcy.2012.02.024
38. Zhang L, Shi X, Xia Y, Mao K (2013) A Multi-filter Based License Plate Localization and Recognition Framework. 2013 Ninth International Conference on Natural Computation (Icnc):702-707
39. Cortes C, Vapnik V (1995) SUPPORT-VECTOR NETWORKS. Machine Learning 20 (3):273-297. doi:10.1023/a:1022627411411
40. Ashtari AH, Nordin MJ, Fathy M (2014) An Iranian License Plate Recognition System Based on Color Features. IEEE Transactions on Intelligent Transportation Systems 15 (4):1690-1705. doi:10.1109/tits.2014.2304515
41. Yang J, Hu B, Yu J, An J, Xiong G, IEEE (2013) A License Plate Recognition System Based on Machine Vision. 2013 IEEE International Conference on Service Operations and Logistics, and Informatics.
42. Zhai X, Bensaali F, Sotudeh R (2013) Real-time optical character recognition on field programmable gate array for automatic number plate recognition system. Iet Circuits Devices & Systems 7 (6):337-344. doi:10.1049/iet-cds.2012.0339
43. Du S, Ibrahim M, Shehata M, Badawy W (2013) Automatic License Plate Recognition (ALPR): A State-of-the-Art Review. IEEE Transactions on Circuits and Systems for Video Technology 23 (2):322-336. doi:10.1109/tcsvt.2012.2203741
44. Sanap PR, Narote SP (2010) License Plate Recognition System-Survey. In: International Conference on Methods and Models in Science and Technology, Chandrigarh, INDIA, 2010
Dec 25-26 2010. AIP Conference Proceedings. pp 255-260
45. Neurocar. http://en.neurosoft.pl/products/neurocar/, Viewed 15 July 2015.
46. Petrovic VS, Cootes TF (2004) Vehicle type recognition with match refinement. In: 17th International Conference on Pattern Recognition (ICPR), British Machine Vis Assoc, Cambridge, ENGLAND, 2004, pp 95-98. doi:10.1109/icpr.2004.1334477
47. Pearce G, Pears, N. (2011) Automatic make and model recognition from frontal images of cars. Paper presented at the 8th IEEE Int. Conf. on Advanced Video and Signal Based Surveillance (AVSS),
48. Ziolko M, Sypka P, Dziech A, Baran R, Peric N, Petrovic I, Butkovic Z (2005) Contour transmultiplexing. ISIE 2005: Proceedings of the IEEE International Symposium on Industrial Electronics 2005, Vols 1- 4:1167-1170
49. Negri P, Clady X, Milgram M, Poulenard R (2006) An oriented-contour point based voting algorithm for vehicle type classification. In: 18th International Conference on Pattern Recognition (ICPR 2006), Hong Kong, PEOPLES R CHINA, 2006, pp 574-577
50. Anthony D (2005) More local structure information for make-model recognition. Dept. of Computer Science, University of California at San Diego,
51. Baran R, Wiraszka D, Dziech W (2000) Scalar quantization in the pwl transform spectrum domain. In: Proc. of the int. conf. of Mathematical Methods in Electromagnetic Theory, MMET2000, pp 218–221,
52. Dziech W, Baran R, Wiraszka D (2000) Signal compression based on zonal selection methods. In: Proc. of the int. conf. of Mathematical Methods in Electromagnetic Theory, MMET2000, pp 224-226,
53 Kazemi FM, Samadi S, Poorreza HR, Akbarzadeh-T M-R (2007) Vehicle recognition based on fourier, wavelet and curvelet transforms - a comparative study. International Conference on Information Technology, Proceedings:939-940
54. Candes E, Demanet L, Donoho D, Ying L (2006) Fast discrete curvelet transforms. Multiscale Modeling & Simulation 5 (3):861-899. doi:10.1137/05064182x
55. Cover TM, Hart PE (1967) NEAREST NEIGHBOR PATTERN CLASSIFICATION. Ieee Transactions on Information Theory 13 (1):21-+. doi:10.1109/tit.1967.1053964
56. Hsu CW, Lin CJ (2002) A comparison of methods for multiclass support vector machines. Ieee Transactions on Neural Networks 13 (2):415-425
57. Do MN, Vetterli M (2005) The contourlet transform: An efficient directional multiresolution image representation. Ieee Transactions on Image Processing 14 (12):2091-2106. doi:10.1109/tip.2005.859376
58. Rahati S, Moravejian R, Kazemi EM, Kazemi FM (2008) Vehicle recognition using contourlet transform and SVM. Proceedings of the Fifth International Conference on Information Technology: New Generations:894-898. doi:10.1109/itng.2008.136
59. Lowe DG (2004) Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60 (2):91-110. doi:10.1023/b:visi.0000029664.99615.94
60. Belongie. http://vision.ucsd.edu/belongie-grp/research/carRec/car_rec.html, Viewed 15 July 2015.
61. Dlagnekov L (2005) Video-based car surveillance: License plate, make, and model recognition. Master's thesis. University of California, San Diego,
62. Zafar I, Acar BS, Edirisinghe EA (2007) Vehicle make & model identification using Scale Invariant Transforms. Proceedings of the Seventh IASTED International Conference on Visualization, Imaging, and Image Processing:271-276
63. Hsieh J-W, Chen L-C, Chen D-Y (2014) Symmetrical SURF and Its Applications to Vehicle Detection and Vehicle Make and Model Recognition. Ieee Transactions on Intelligent Transportation Systems 15 (1):6-20. doi:10.1109/tits.2013.2294646
64. Hui-Zhen Gu & Suh-Yin Lee (2013) A view-invariant and anti-reflection algorithm for car body extraction and color classification, Multimedia Tools and Applications 65, 387-418, doi=10.1007/s11042-012-0996-1
65. Dule E, Gokmen M, Beratoglu MS (2010) A Convenient Feature Vector Construction for Vehicle Color Recognition. Recent Advances in Neural Networks, Fuzzy Systems & Evolutionary Computing.
66. Hu W, Yang J, Bai L, Yao L (2013) A New Approach for Vehicle Color Recognition Based on Specular-free Image. In: 6th International Conference on Machine Vision (ICMV), London, 2013, Nov 16-17 2013. Proceedings of SPIE. doi:90670a10.1117/12.2051976
67. Kim K-J, Park S-M, Choi Y-J, Ieee Computer SOC (2008) Deciding the Number of Color Histogram Bins for Vehicle Color Recognition. 2008 Ieee Asia-Pacific Services Computing Conference, Vols 1-3, Proceedings. doi:10.1109/apscc.2008.207
68. Park Sun-Mi, Kim Ku-Jin (2008) PCA-SVM Based Vehicle Color Recognition. Korea Information Processing Society Transactions on Software and Data Engineering (PartB) 15 (4):285-292. 10.3745/KIPSTB.2008.15-B.4.285
69. Wu Y-T, Kao J-H, Shih M-Y (2010) A Vehicle Color Classification Method for Video Surveillance System Concerning Model-Based Background Subtraction. Advances in Multimedia Information Processing-Pcm 2010, Pt I 6297:369-380
70. Spring. http://springsource.io, Viewed 15 July 2015.
71. Baran R, Glowacz, A., Matiolanski A. (2013) The efficient real-and non-real-time make and model recognition of cars. Multimedia Tools and Applications. doi:DOI: 10.1007/s11042-013-1545-2
72. Bay H, Ess A, Tuytelaars T, Van Gool L (2008) Speeded-Up Robust Features (SURF). Computer Vision and Image Understanding 110 (3):346-359. doi:10.1016/j.cviu.2007.09.014
73. Gorzalczany MB, Rudzinski F (2008) WWW-newsgroup-document clustering by means of dynamic self-organizing neural networks. In: Rutkowski L, Tadeusiewicz R, Zadeh LA, Zurada JM (eds) Artificial Intelligence and Soft Computing - Icaisc 2008, Proceedings, vol 5097. Lecture Notes in Artificial Intelligence. pp 40-51
74. Nister D, Stewenius H (2006) Scalable recognition with a vocabulary tree. In: Conference on Computer Vision and Pattern Recognition, New York, NY, USA, 2161{2168
75. libpmk. http://people.csail.mit.edu/jjl/libpmk/, Viewed 15 July 2015.
76. Grauman K, Darrell T (2007) The pyramid match kernel: Efficient learning with sets of features. Journal of Machine Learning Research 8:725-760
77. VocabTree2. https://github.com/snavely/VocabTree2, Viewed 15 July 2015.
78. Agarwal S, Snavely N, Simon I, Seitz SM, Szeliski R, Ieee (2009) Building Rome in a Day. In: 12th IEEE International Conference on Computer Vision, Kyoto, JAPAN, 2009
Sep 29-Oct 02 2009. IEEE International Conference on Computer Vision. pp 72-79. doi:10.1109/iccv.2009.5459148
79. Csurka G. DCR, Fan L., Willamowski J., Bray C. (2004) Visual categorization with bags of keypoints. Paper presented at the Workshop on Statistical Learning in Computer Vision, ECCV
80. K. G (2006) Matching Sets of Features for Efficient Retrieval and Recognition,. MIT,
81. Witten IH, Frank, E. (2005) Data Mining: Practical Machine Learning Tools and Tech-niques, 2 ed. . Morgan Kaufmann, San Francisco, CA, USA
82. OpenCV. http://opencv.org/documentation.html, Viewed 15 July 2015.
83. Tesseract. http://tesseract-ocr.repairfaq.org/, Viewed 15 July 2015
84. Heliński M. KM, Parkoła T. (2012) Report on the Comparison of Tesseract and Abbyy Finereader OCR Engines Paper presented at the PCSS, Poznan, POLAND
85. Axalta. http://www.axaltacs.com/content/dam/AP/Axalta/Korea/Axalta%202013%20Global%20Color%20Popularity%20Report.pdf, Viewed 15 July 2015. 
Pełny tekst 
DOI 
Web of Science