|Prachi Kawalkar, Girish Talmale
|Related article at Pubmed, Scholar Google|
Visit for more related articles at International Journal of Innovative Research in Computer and Communication Engineering
Demand for augmented hardiness, higher responsible and high automation of image analysis algorithms is apparent in recent years. Precise designation and prognosis is crucial to scale back the high death rate. In this paper, we are going to discuses different techniques for pre-processing, segmentation, feature extraction and classification of biomedical images to detect and classify glands in human tissues. Additionally here we concentrate on some issues and problems regarding to biomedical images and solution to that particular problems. The crisis is such as noisy images, different straining techniques and calculation of pixel values. The study covers different methods like polar conversion, along with object based segmentation and SVM classification. As a result final outcome shows the structure of glands along with the grading results.
|Cancer, H&E, H-DAB, Pre-processing, Grading, SVM, Hperplane.|
|In last few years, there is drastic changes occur in human body just because some bad environmental tribulations or may be as improper or unhealthy food. As a result different disease comes into existence. Especially disease’s just like cancer speedily grown. Cancer is class of diseases in which growth of cell is out-of-control. According to survey about 100 types of cancer present depending on nature of cells. Statistic based on world health organization  and worldwide cancer statistics  report about 14.1 people was diagnosed with cancer in 2012. And due to belatedly detection of there were 8.2 million deaths from cancer in the world in 2012 according to above statistics.|
|To remove this drawback it is necessary to develop such system which gives accurate and early output build on patient samples. To save millions of life, we need to develop such system which is fully automatic scheme. When any type of disease is suspected, tissues samples taken from patient by pathologist and observe under microscope. And when such samples viewed under microscope if standard structure of component differs from observed samples then it is clear that result is positive. Main task of diagnostician is to analyzing, locating and classifying most of the diseases, equally seem at the tissue structure, distribution of cells in tissue, regularities of cell shapes and confirm benign and syndrome in image. It is very important because the gland in human tissues is the area where cancer can be pragmatic. But this method is simply too time intense and result in intra and put down observer variability. To get rid of this disadvantage automatic detection of pictures is required for quantitative diagnosing of Tissue.|
|Recently many universities and research centre focuses on this type of problems. Like any real time biomedical images which is obtained from the pathology lab is no too much clear to indentify the basic structure/component, which may lead to bad results. Much automatic detection system developed to overcome this type of drawbacks as we will discuss in later section. But it facing some problems such as irregular shapes of gland, overlapping and unlike way of sectioned during variety etc.|
|This paper based on the method of gland detection and classification, by using image processing domain . So it is necessary to know the basic structure of glands. Actual position of gland present in human tissue. More than one gland present in tissues which may be in form of tubular or flak-shaped structure. Each and each glands composed of cluster of nuclei enclosed by protoplasm and lumen space. Lumen space invariably Associate in nursing empty region. Positioned between glands called stroma that contains remote nuclei while not fastidious patterns of arrangement .|
|Section II surveys connected work, in section III proposed methodology discuss in details. III-A and III-B, justify pre-processing and segmentation techniques for pictures, equally section III-C and III-D, includes concerning the feature extraction and classification along with flowchart embody in section III. After total image processing procedure complete implementation and evaluation discuss in section IV. Followed by, conclusion V on the study is given in section III and IV with future work.|
II. RELATED WORK
|As this system related to biomedical image processing, input for such application is always an image of patients slides. Such slides made up by two staining techniques called H&E (Hematoxylin and Eosin) and H-DAB (the combination of Diaminobenzidine and Hematoxylin) [5, 6, 11]. Whereas component in H&E stained images are of different colours and most frequently used in pathology. But for H-DAB staining case only cancerous nuclei shown in blue in colour otherwise all components are colourless. As per survey conducted on H-DAB  it is clear that this staining technique rarely used in pathology. Though this 2 techniques a lot of widespread however up until currently most of the analysis done on H & E stained pictures [5, 6, 8, 9, 10, 11]. Only a few analyses on H-DAB pictures .|
|Related research carried out on pre-processing is described as: According to an author Hitesh Garge  he suggested Adaptive Weighted Median Filter method to remove noise from input image and enhance filtering capacity . AWMF permit removing outlier while not moving the sharpness of image and conjointly facilitate to get rid of inevitable speckle noise in U.S. pictures. In some cases input images are of RGB (red green blue) in nature so first step is to convert that colour image into gray scale image .|
|Related research carried out on segmentation is described as: In March 2010, author Altunbay  used unsupervised segmentation loom for involuntary system similarly  worn feed-forward neural network trained image. Some other recent segmentation techniques used earlier such as biased median filtering image segmentation  and region growing algorithm . As name method in  it distribute the cells and in  Wu HS and XuR comments that glands calculate on basis of lumen surface and then distinguish in into true or false glands followed by some parameters.|
|Two types on segmentation carried out in research field called pixel based  and object based . Farjam et al.  in his research used texture feature with k-means cluster to find out glands. According to him that utterly totally different parts in tissue like stroma, nucleus and Lumina have their own utterly various structure properties. Author of article  Nguyen, Anil Jain, and Ronald, apply 3 stage algorithmic programs for segmentation, in terribly initiative pixels into completely different categories, extraction of gland boundary in second stage and complete gland structure in final part. In object primarily based impend, sophisticated objects square measure known with some or additional attributes. Author Basavanhally  used the O’Callaghan neighbourhood to unravel hassle of tube (lumen, cytoplasm, and nuclei) identification on stained breast malignancy pictures. It separate object of interest from whole image by numerous ways like thresholding , morphological hierarchy, morphological pyramid , etc. In microscopic anatomy it's accustomed sight nuclei, stroma, background thus on and results of this could be accustomed produce 3D constructions with the assistance of various algorithmic rule.|
|Related research carried out on Feature extraction and selection is described as: In previous research papers [9, 13, 18, 20] describe the skewness, roundness factor, average, max of lumen perimeter, first-order histogram based features, variance feature, hear wavelet feature, kurtosis, quantity of lumen, nuclear thickness, multiple fractal-dimension-based feature, relative amount of lumen area to total segment area, ratio of blue nuclei features for getting proper and accurate output. Similarly as research carried out in 2008 by research scholar scot Doyel  in his analysis apply textural and nuclear field options for investigation of carcinoma image. As shown in  they Drew Delaunay triangulation illustration on centroids of cell nuclei. It takes histopathology as associate degree input and generate colour graph within which edges shown by totally different colour supported element within the image. Until now texture feature (smoothness, regularity, angular second, correlation etc.), graph features (roundness, total node, edges, area spectral radius etc.) and morphological features (radius, parameters, size, shape, boundary etc.) were used.|
|Related research carried out on classification is described as: Number of research papers and articles publish on classification technique some of them methods which is related to this application are described by machine learning algorithms like neural network , logistic regression algorithm, k-nearest neighbourhood, fuzzy method etc. In  worked on SVM skill to categorize oral mucosa images. Equivalent SVM method along with k-nearest neighbour classifier and multilayer perception used in “Automated gland segmentation and classification for Gleason grading of prostate tissue images” . One of the applications of classifier is to distinguish glands into grading scheme for that bayes classifier  used as reference.|
|Although there are large and varieties of techniques and methods present for image processing projects there are some limitations over it. Such as unclear picture quality, accuracy, time period, classification and lack of knowledge. Some disadvantages calculated in terms of fails in extended components, somewhere gives false negative result, too many feature production which causes the ambiguity, many times can’t calculate estimation of gland area and so on.|
III. PROPOSED WORK
|Proposed work fully based on the medical research field. Aim of scheme is to detect structure of glands and sort the glands according to grading. And final output is generation of report just akin to pathology report along with detail description of disease  (affected samples). Main objective of system is to propose a new method to detect glandular structures in microscopic images of human tissue, seek to invent an algorithm for the automated detection of glandular structures in human tissues, design decision support system and generate grading report for each cytological sample.|
|A. Input Image:|
|As this application depend upon medical field, so the propose paper implement method that does not rely on the colour information and hence it is applicable to both H&E image and H-DAB image .|
|As such application totally depends on medical images. And we know that medical images are too much complex in nature and not too much clear to identify minute components in it. Some images are also real time images (images taken from patient samples put into sliding) which consist of noise in form of dust, figure prints of worker, unclear structure etc. To get smart output of image segmentation and classification it's obligatory to enhance image feature by removing noise, enhancing brightness, etc. Removing low-frequency surroundings noise, normalizing the intensity of the personage unit pictures, removing reflections, and masking fraction of pictures are indispensable gears of image process. Image pre-processing is that the technique of decorative knowledge pictures before machine process. Though numerous enhancement algorithms are presented in literature, but studies which are pertinent and suitable for this application are discussed in this section. The real time biomedical images contain very large amount of noise as well as it is not too much clear to recognize accurate structure of components.|
|Step 1: Gray Scale Conversion|
|Before proceeding to segmentation, feature extraction and classification it is necessary to perform preprocessing. Final result of pre-processing is to create or generate such image which having high pixel intensity and more clear to identify region of interest from an images. It is first step in pre-processing called as gray scale conversion. In this paper we are going to precede both color and colorless images so it is necessary to convert RGB into gray scale i.e. black and white.|
|S = T( r )|
|r is the pixels of the input image and S is the pixel of the output image and T is transformation function that maps each value of r to each value of S.|
|Step 2: Partition into Sub-Images|
|After conversion of image into gray scale we perform partitioning. Whole 1024*1024 images divided into patches called as sub-imaging. Application to perform partitioning is to concentrate on minute parts of images more clearly and time conserving.|
|Step 3: Conversion from Cartesian to polar form|
|After conversion it into sub image each sub image is in form of Cartesian form so convert it into polar image of 0 to 2π and π to 3π. So that patch of image can see in two different angles and final pre-processing step is to apply|
|Step 4: Histogram equalization|
|Primarily aim of Histogram equalization is for enhancing the contrast of image. It has two parts known by name probability mass function and cumulative distributive function. Final pre-processing step is to apply histogram equalization operation on polar images. Because there we calculate rue and false gland so to reduce intensity variation between two types of glands histogram equalization operator added.|
|Image segmentation is method of dividing image into numerous segments, this represented as pixel or sub-pixels. To investigate image a lot of simply and effortlessly, segmentation changes the illustration of a picture and find objects and bounds like lines, curve etc further as assign label to every and each pixel having sure characteristics. In diagnosing, segmentation once pre-processing is one amongst the vital steps to mechanically designation of diseases. According to previous survey primarily secretors organ segmentation approach categorized into 2 varieties 1st as .|
|1) Pixel based mostly Segmentation: It tries to discover region of interest organ or non region of interest of any organ for every component [5, 8, and 9].|
|2) Object based mostly Segmentation: It capture the inner info of organ and treat as object [11, 15, and 17].|
|In this paper we have to discuss about object based segmentation. Main task of segmentation is to find out boundary of interested region and final output of this step is proposed glands for that we apply unary, pair-wise potential along with inference algorithm. Inference method individually applied on those two different polar angles of same sub images. Finally add that two different angles of image into one by using gland contour detection algorithms. Whereas inference engine generally used for finding most probable path/ pick similarly for analysis of coding and noncoding sequences, probability and known parameters. It commonly used by speech recognition system. In this paper two glands energy level nearly same so we can calculate exact location identity.|
|D. Feature Eraction and Selection:|
|To identify abnormalities or to classify pictures into totally different grades of diseases, feature extraction and choice plays a very important role. As given system related with the glands detection of human tissue where abnormal size of glands lead to the cancer. In each stage gland size and distance between them gradually changes. In last stage of cancer glands fuse into each other which represent the irregular patterns in the human tissues. Therefore to measure the benign and malignant samples of tissues need to extract its features. The new options we'll introduce are: the size of the secretor; the relative position of the secretor (gland) centre with relation to the image size; the common intensity of the gland contour in the original image and within the bar graph equalized sub-image. Beside this we consider energy as one of important feature in the detection and classification criteria. To calculate these options, we have a tendency to 1st have to be compelled to label the segmental glands.|
|It is very important and final stage of every project. Main aim of this classifier is to classify images according to some parameters. The distinctive classifiers area unit accustomed categories pictures for analyse irregularity in image once segmentation and have extraction method. They classify cells or tissues in line with some categories so conjointly observe the malignancy level specially samples. In given paper we have to classify glands in human tissue according to grading. In medical terms any tissue samples divided into three parts grade I, grade II and grade III according to their growth. According to survey numerous classification techniques were used such as neural network, SVM (support vector machine), decision tree, and fuzzy classification . Among all this we have to implement SVM classifier for grading of human tissues.|
|A Support Vector Machine (SVM) may be a discriminative classifier formally outlined by a separating hyperplane. We can use a SVM once our knowledge has precisely 2 categories. Associate degree SVM categories knowledge by finding the most effective hyperplane that separates all knowledge points of 1 category from those of the opposite class. The most effective hyperplane for associate degree SVM means that the one with the biggest margin between the 2 categories. Margin is defined as the maximal dimension of the block parallel to the hyperplane that has no interior knowledge points. Points within the direction of the traditional vector are classified as Positive, and points within the other way area unit classified As Negative.|
|F. Training Set Generation:|
|The last stage called training sets; here we used about 20 images as into action for training sets. Though it contains only 20 images in training sets, it includes nearly 600 glands. The coaching set is employed to coach the SVR model and verify the structure of the glands furthermore because the parameters contained in it. Once these parameters area unit learned, they're mounted and will be directly applied on the testing pictures. All the results to be reported below area unit the performance on the testing set, unless otherwise explicit.|
IV. IMPLEMENTATION AND EVALUATION
|To implement automatic system which carried out the detection and segmentation of glands we implement/ design decision support system. As shown in figure 3a and 3b original datasets called as H&E and H-DAB used to proceed for detection and sorting. H&E datasets having RGB image format they firstly converted it into gray scale given by fig. 3c|
|In this project, we have a tendency to execute total 5 modules; they are pre-processing, segmentation, feature extraction, classification and training set generations. In this project we used four basic primary approaches for getting accurate output. Such output is beneficial to medical fields for evaluation and study purpose. Next step after gray scale conversion is histogram equalization which is shown by fig 4a and 4b of respected datasets.|
|To design such framework we design primary step in which all obstacles in the images drop out. Aim of preprocessing is an upgrading of the image knowledge that suppresses additional distortions or enhances some image options crucial for more process. We create one user defined platform in which we access any type of images from databases, and then user can upload one image. After uploading stained image we perform some pre-processing steps as mention in proposed work and show in below figures. As soon as Initial stage of project completed we apply segmentation process and output of this model is to highlighted gland portion. After getting rough boundary of glands, based on this outline we classify and extract features for output results. For this mathematical calculation just like scheming centroid and perimeter etc., And according to calculation and feature we generate report. Report such as whether given input image is normal or abnormal along with grading of images.|
|The last and very important step called as segmentation which is shown by fig 5a and 5b in which each and every gland in tissue are segmented according to fast and robust method.|
|To recognize terribly precarious and crucial illness like cancer by system with terribly short interval of time isn't a really straightforward assignment. In this paper different glands are detected and generating results according to their categories. As earlier detection and differing kinds of databases of medical image and totally different process proves to be a difficult in image analysis. Summarizing the bestowed solutions, promise and provides an honest base for additional analysis within the space of cytological image segmentation. Every steps/stages reused in future project which require such style of data.|
|We would like to thank the subsequent people for their assist Dr. Radhika Pagey to understanding the complete slide preparation procedure for image and basic knowledge about cancerous tissue.|
|We would extend my vote of thanks to RST Regional Cancer Hospital & Research Centre for providing Real time databases.|
3. Gonzalez, R.C., and Woods R.E, “Digital image processing”, Pearson Education, 2nd Edition, 2003.
4. Hao Fu, Guoping Qiu, Jie Shu, and Mohammad Ilyas,” A novel polar space random field model for the detection of glandular structures” ,IEEE Trans on Medical Imaging, Vol. 33, No. 3, March 2014.
5. J. Diamond, N. H. Anderson, P. H. Bartels, R. Montironi, and, P. W. Hamilton, “The use of morphological characteristics and texture analysis in the identification of tissue composition in prostatic neoplasia”, Human Pathol., vol. 35, no. 9, pp. 1121–1131, Sep. 2004.
6. C. Smochina,V. Manta, and W. Kropatsch, “Crypts detection in microscopic images using hierarchical structures”, Pattern Recognit. Lett., vol. 34, no. 8, pp. 939–941, Nov. 2013.
7. Hrushikesh Tukaram Garud, Debdoot Sheet, Manjunatha Mahadevappa, Jyotirmoy Chatterjee, Ajoy Kumar Ray, Arindam Ghosh,” Breast fine needle aspiration cytology practices and commonly perceived diagnostic significance of cytological features:A pan- India survey”, Journal of Cytology, Vol. 29, Issue 3, July 2012
8. H.-S. Wu, R. Xu, N. Harpaz, D. Burstein, and J. Gil, “Segmentation of intestinal gland images with iterative region growing”, J. Microsc., vol. 220, no. 3, pp. 190–204, 2005.
9. R. Farjam, H. Soltanian-zadeh, K. Jafari-khouzani, and R. A. Zoroofi, “An image analysis approach for automatic malignancy determination of prostate pathological images”, Cytometry Part B (Clin. Cytometry), vol. 72B, no. 4, pp. 227–240, 2007.
10. M. N. Gurcan, L. E. Boucheron, A. Can, A. Madabhushi, N. M. Rajpoot, and B. Yener, “Histopathological image analysis: A review”, IEEE Rev. Biomed. Eng., vol. 2, pp. 147–171, Jan. 2009.
11. C. Gunduz-Demir, M. Kandemir, A. B. Tosun, and C. Sokmensuer, “Automatic segmentation of colon glands using object-graphs”, Med. Image Anal., vol. 14, no. 1, pp. 1–12, Feb. 2010.
12. A.Belsare, and M. Mushrif, “Histopathological image analysis using image processing techniques: An overview”, Signal Image Process., vol. 3, no. 4, pp. 23–36, 2012.
13. Hitesh garg, and alka jindal, “Segmentation of thyroid gland in ultrasound image using neural network”, IEEE Trans, July 2013.
14. T. Loupas, W. N. McDicken, and P. L. Allan, “An adaptive weighted median filter for speckle suppression in medical ultrasonic images” , IEEE Trans. Circuits Syst., vol. 36, pp.129–135, Jan. 1989.
15. D. Altunbay, C. Cigir, C. Sokmensuer, and C. Gunduz-Demir, “Color graphs for automated cancer diagnosis and grading”, IEEE rans. Biomed. Eng., vol. 57, no. 3, pp. 665–674, Mar. 2010.
16. Hai-Shan Wu, and Joan Gil, “A Biased median filtering algorithm for segmentation of intestinal cell gland images”, Scientific World Journal, 2006.
17. Basavanhally, E. Yu, J. Xu, S. Ganesan, M. Feldman, and E. Al, “Incorporating domain knowledge for tubule detection in breast histopathology using O’Callaghan neighborhoods”, in Proc. SPIE Med. Imag.: Comput.-Aid. Diagnosis, pp. 1–15, 2011.
18. K Nguyen, Anil K. Jain, and Ronald L. Allen, “Automated gland segmentation and classification for gleason grading of prostate tissue images”, international conf. on pattern recognition, 2010
19. Scott Doyle, Shannon Agner, Anant Madabhushi, Michael Feldman, John Tomaszewski, “Automated grading of breast cancer histopathology using spectral clustering with textural and architectural image features”, IEEE. 978-1-4244-2003-2/08, 2008.
20. S K Tai, Y C Wu, Cheng-Yi Li, Y J Jan, and S C Lin, “Computer-assisted detection and grading of prostatic cancer in biopsy image”, IMECS, march 2010.
21. M. Muthu Rama Krishnan, Mousumi Pal, Suneel K Bomminayuni, Chandan Chakraborty, Ranjan Rashmi Paul, Jyotirmoy Chatterjee, Ajoy K Roy, “Automated classification of cells in sub-epithelial connective tissue of oral sub-mucous fibrosis – An SVM based approach”, Computers in Biology & Medicine 39, 1096-1104, 2009.
22. Pooja Kamavisdar, Sonam Saluja, Sonu Agrawal ”A Survey on Image Classification Approaches and Techniques”, International journal Vol. 2, Issue 1, Jan 2013