Saturday, October 26, 2013

OpenCV Computer Vision Application Programming: Review

I was pleasantly surprised when I heard that there is a video tutorial for learning OpenCV out in the market.

Its available for download at http://bit.ly/1eJjrWN. A preview of the video can be seen at http://bit.ly/1gpqpPW.

I did see a few videos on YouTube for "OpenCV Tutorials", but they weren't organized properly. Its good to see an author walk you through all the basic modules of OpenCV. The author discusses about OpenCV installation, basic C, C++ and Python interfaces. There is a video on Face Recognition, Image Morphology, Image segmentation, Calibration, Training your own HAAR cascade classifier, etc. I specifically looked into "Working with HDR Images" video and was disappointed. The author only talked about how to use a ready made program in Linux and how to save HDR images using the built program. It is sad that OpenCV is already more updated after the release of this video (like saving HDR images programatically http://docs.opencv.org/trunk/doc/tutorials/photo/table_of_content_photo/table_of_content_photo.html).

The instructions in the video focus primarily on using the OpenCV interface. If you want to know why are do you want to use a certain instruction/statement, you will have learn Image Processing, Machine Learning/Pattern Recognition. The code written by the author is available for download along with the videos.

Although, I would have liked the author to place all the code in a single folder and explain using that organized folder (I could see the author only opening up random files, executing binary, explaining output and explaining the code.

The programming has been primarily done in C++ which is nice. Most of developers prefer C++ for their development. Its also easier to port the code to mobile or across different platforms. It is a good addition to Packt's OpenCV book http://www.packtpub.com/opencv-2-computer-vision-application-programming-cookbook/book .

P.S. I received a free copy of video tutorial of "OpenCV Computer Vision Application Programming" for writing the review.

Sunday, June 9, 2013

Logisitic Regression in OpenCV

I finished writing a Logistic Regression classifier in OpenCV. I've seen a lot of posts on the web asking for OpenCV's version of the same but its not available. Its easy to write your own logistic regression classifier.

I separated out the cost function and gradient descent algorithm (Batch Gradient Descent). You can replace it with your own optimization algorithm.
I posted it on my Github page. You can check it out:


Saturday, March 9, 2013

Reading and Writing cv::Mat in OpenCV in C++

In C++ api for OpenCV, you often come across writing and reading matrices as text files (analogous to saving .mat files in MATLAB/Octave). This is a simple way of doing it. You could even save multiple matrices in a single .xml/.yaml file. 
Note: You could write matrices using C++ and use Python API (which is very useful for Prototyping as development on Python is faster than C++ and many Machine Learning APIs are available for use).

However, I couldn't find ways to read more than 1 matrix which was written to file and being read using Python API. 

Matrix types in using imshow and imwrite

I have never paid attention to trivial functions in OpenCV like

while using matrix types.

It turns out that only 3 Channel or Single Channel images can be saved using imwrite (in specific 8bit images, and 16 bit images of PNG, JPEG 2000 and TIFF type). Click here for more details.

For example, the following image has values from 0 to 1 (floating type), but when you write it to disk, all you can see is "NOTHING". That is so because, imwrite only writes 8 bit 3 channel or 1 channel images. Also when you do an imread on the same image, you get a 8bit image. Its not the same CV_32F image that you've written to disk.

Other formats of cv::Mat have to use FileStorage class provided with OpenCV. Using this one can save matrices of type CV_32F.

Friday, February 15, 2013

Logistic Regression in python

I wrote a Logistic Regression classisifier in Python using Numpy.

You can checkout the source code for the Logistic Regression classifier here

Its a multi-class classifier written in Python (uses a one vs rest kind of classification strategy). It also works for 2 class data-sets.

It uses Conjugate/Batch Gradient Descent to learn the parameters of the Logistic Regression. You can edit it to make it work with optimization module in Scipy.

You can clone the source using the following command:

Sunday, January 27, 2013

Machine Learning on Coursera

Late last year, I finished Andrew Ng's course on Machine Learning in www.Coursera.org. It was absolutely wonderful. I have learnt a lot from that course. I got a perfect score of 100%.



Finally, I overcame the procrastination to learn to program in Matlab/Octave effectively. I felt very comfortable in dealing with Octave. Previously, I thought Octave had very less features compared to Matlab. It is kind of true. But, you could manage writing code that could solve complex problems without spending much money on a Matlab License.

Andrew Ng has been absolutely phenomenal in explaining complex problems clearly. The new stuff that I learnt was:
  1. Logistic Regression.
  2. Neural Nets.
  3. Support Vector Machines.
  4. Debugging Machine Learning problems.
  5. Know how(theory) of using certain optimization algorithms on Map-Reduce.
My background in Pattern Recognition did definitely help in it. I was working in a related area of research, it helped in finishing my Master's Thesis too! Now I'm pretty confident on taking on any ML problem/assignment.

Now, I have time to complete other interesting courses such as Probabilistic Graphical Models and Neural Networks for ML.

Thanks Dr. Andrew Ng and Thank you Coursera!

And yeah, this my certificate.


Debugging Machine Learning problems

Useful links in Machine Learning.
  1. COURSE ERA: ANDREW NG.
  2. http://arkitus.com/PRML/
  3. http://thebayesianobserver.wordpress.com/2012/02/07/debugging-machine-learning-algorithms/
  4. http://www.kdnuggets.com/2012/09/pedro-domingos-useful-things-about-machine-learning.html