Machine Learning Techniques used for the Histopathological Image Analysis of Oral Cancer-A Review
Santisudha Panigrahi1, *, Tripti Swarnkar2
Identifiers and Pagination:Year: 2020
First Page: 106
Last Page: 118
Publisher Id: TOBIOIJ-13-106
Article History:Received Date: 20/03/2020
Revision Received Date: 01/07/2020
Acceptance Date: 23/09/2020
Electronic publication date: 30/11/2020
Collection year: 2020
open-access license: This is an open access article distributed under the terms of the Creative Commons Attribution 4.0 International Public License (CC-BY 4.0), a copy of which is available at: https://creativecommons.org/licenses/by/4.0/legalcode. This license permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Oral diseases are the 6th most revealed malignancy happening in head and neck regions found mainly in south Asian countries. It is the most common cancer with fourteen deaths in an hour on a yearly basis, as per the WHO oral cancer incidence in India. Due to the cost of tests, mistakes in the recognition procedure, and the enormous remaining task at hand of the cytopathologist, oral growths cannot be diagnosed promptly. This area is open to be looked into by biomedical analysts to identify it at an early stage. At present, with the advent of entire slide computerized scanners and tissue histopathology, there is a gigantic aggregation of advanced digital histopathological images, which has prompted the necessity for their analysis. A lot of computer aided analysis techniques have been developed by utilizing machine learning strategies for prediction and prognosis of cancer. In this review paper, first various steps of obtaining histopathological images, followed by the visualization and classification done by the doctors are discussed. As machine learning techniques are well known, in the second part of this review, the works done for histopathological image analysis as well as other oral datasets using these strategies for growth prognosis and anticipation are discussed. Comparing the pitfalls of machine learning and how it has overcome by deep learning mostly for image recognition tasks are also discussed subsequently. The third part of the manuscript describes how deep learning is beneficial and widely used in different cancer domains. Due to the remarkable growth of deep learning and wide applicability, it is best suited for the prognosis of oral disease. The aim of this review is to provide insight to the researchers opting to work for oral cancer by implementing deep learning and artificial neural networks.
Over the past decades, a continual evolution associated with cancer analysis has been performed . To find out the types and stages of cancer, scientists have developed different screening methods for early stage diagnosis [2-7]. An enormous quantity of cancer information has been gathered with the introduction of new technologies and is accessible to the medical research community . But one of the most challenging tasks for the doctors is to accurately predict the type of cancer. Therefore, several machine learning techniques are used by medical researchers. These techniques are capable of discovering patterns and relationships among them and can efficiently predict the future outcomes of a cancer type from complicated datasets.
As machine learning techniques are more popular, a review of studies using these methods to predict oral cancer is presented.
Many characteristics that are connected with cell morphology can be acquired from digital histopathological images. It, thus, represents one of the systems’ fundamental steps to classify cells regardless of context . Numerous supervised  and unsupervised  machine learning algorithms have been put forward in latest years for the classification of histopathological images like support vector machines [12, 13], neural networks , decision tree , fuzzy and genetic algorithms , k-NN [17, 18], kernel PCA , etc. These models can be extensively used for other areas of medical science, such as medicine and clinical research .
The neural network has developed a new area of science that is different from today's computer algorithmic calculation method . The neural network is inspired by the biological neural structures and has a naiver framework. Many developed neural network systems follow some eminent features of the learning ability of biological neural networks [22, 23]. Instead of neural, physiological approaches, engineering approaches are incorporated for developing other features. The neural network by learning ability can produce new data and discover new outputs. The neural network observes learning samples, generalizes them, and produces a learning rule from the samples. The neural networks can use the learning rules to decide on any of the samples that were notseen before .
Fig. (1a) reflects the number of articles on oral cancer from the last nine years (2010-2018, including various kinds of information sets such as genomics, molecular, clinical, microarray, etc.). The use of machine learning methods in histopathological cancer images has been created relevant to a comprehensive search. The study demonstrates a fast rise in articles that have been released in the last decade based on ML apps in cancer prediction. It is still an open area to be explored. Fig. (1b) reflects paper for multiple types of cancer that have been published over the previous five years using deep learning with histopathological images. In oral cancer, only a few papers were published. Although the application of deep learning techniques is quite high for other types of cancer, the use of histopathological images of oral cancer has accomplished much less work.
For complex computer vision assignments, such as object detection, the Convolutional Neural Networks (CNN) were implemented with excellent achievements in deep learning techniques . The latest studies have shown that CNNs can also be used as an efficient method for low-level image processing problems, such as restoration , denoising , , and mitosis detection . This research discusses the classification of oral cancer as well as other cancers from the H&E color stained tissue pictures. The classification outcome can be used as the input for other assignments like the extraction of the nucleus feature classification or diagnosis.
Heterogeneous types of data like clinical, imaging, and genomics can provide enough information to identify the cancerous tissue [30-32]. The clinical examination allows for direct visualization, but a deep disease extension cannot be evaluated [33, 34]. Cross-sectional testing is becoming the basis for the pre-treatment assessment of these cancers and offers precise data on the extent and depth of the illness that can assist pathologists to determine the suitable management approach and indicate a prognosis .
2. ORGANIZATION OF THIS PAPER
The rest of this document is arranged as follows. An overview of oral cancer and histopathology is provided in section three. A machine learning overview is provided in the fourth section. The fifth section is the literature review that discusses various machine learning methods used for oral cancer and deep learning for other cancer kinds. Section six is the discussion that addresses the challenges and future scope. The conclusion is in the last seventh section.
3. OVERVIEW OF ORAL CANCER AND HISTOPATHOLOGY
Histopathology is the human tissue analysis for a particular disease. This analysis method goes approximately as follows in clinical practice. First, a biopsy is drawn from a patient and sent to the pathology laboratory. Then a glass slide is prepared by coloring the tissue. The purpose of staining is to highlight the different structures of the tissue. For instance, staining tissue from hematoxylin and eosin (H&E) provides a dark purple color to nuclei and pink color to other structures. A pathologist can examine the tissue using a microscope after the tissue is ready and stained . This total workflow is represented in Fig. (2).
|Fig. (1). (a) Publication of papers in oral cancer (b) Publication of papers in different types of cancer in the year 2018.|
|Fig. (2). Collecting and processing of tissue specimens (left). AmScope B120C-E1 Siedentopf Binocular Compound Microscope (right) .|
Oral cancer relates to cancer occurring in the region of the head and neck . India represents 86% of instances of oral cancer . The most prevalent cancer in both males and females is oral cancer. The primary cause of oral cancer is chewing or smoking tobacco, a disease that claims the life of 10,000 individuals every year. Oral cancer begins in the mouth cells of the oral cavity and consists of many components such as lip, tongue, hard palate (mouth roof), mouth floor, gums, and teeth. In recent years, oral cancers have increased and further new cases are reported each year. Although the oral cavity is readily available for inspection, there is no diagnosis of oral squamous cell carcinoma (OSCC) until an advanced phase of illness has been detected [39-43]. At stage III or IV, nearly two-thirds of OSCCs are diagnosed with spread to neighboring tissues and regional lymph nodes, resulting in a poor overall survival rate of 5 years [44-47].
Oral cancer incidence is the highest in the world and the prevalence in females is smaller than in males (Global Oral Cancer Incidence Data, 2016) . Oral cancers can occur in various kinds, such as squamous cell carcinoma, verrucous carcinoma, minor carcinoma of the salivary gland, lymph epithelial carcinoma, etc. About 90% of oral diseases are squamous cell carcinoma (SCC) . In the ordinary situation, the throat and mouth are filled with stratified squamous cells. There is only one layer in contact with the basement membrane of this squamous cell. The epithelial layer's structural integrity is preserved by adhering to one layer. When cancer affects, this structural integrity is lost. SCC can be classified as well-differentiated SCC (WDSCC), mildly differentiated SCC (MDSCC), and badly differentiated SCC (PDSCC). SCC grading relies on how simple it is to recognize indigenous squamous epithelium features (for e.g., intercellular bridges, keratinization, etc.) .
A physician actually observes the suspected lesions. If he or she realizes any cancerous lesion, he indicates that the patient has to go for a confirming test, such as a biopsy. Biopsy sections prepare stained slides of hematoxylin and eosin (H&E) and are then found under the microscope. The irregularities (i.e. the various objects on the slide, including cell organization, atomic size and shape, cell size and shape, etc.) are observed by a pathologist to diagnose cancer through the microscope. An oncologist will give the patient a diagnosis depending on the pathologist's report. Fig. (3) shows the entire workflow. It is, therefore, essential for such a study to be as precise as possible. However, for each unit of the slide and feature analysis, the entire manual observation process is tedious and requires a great deal of experience. In addition, the report can also be observer biased. Because of these problems, a computerized scheme of the above-mentioned method can decrease bias and time, thereby increasing the precision of feature assessment. Therefore, the need for the hour is a computer-aided diagnostic (CAD) system for the prognosis of oral cancer, particularly in a developing and resource-poor nation such as India. It will assist in high-volume laboratories and in cancer screening camps where most instances can be benign and where the pathologist can focus mainly on the instances diagnosed by the system as malignant. Computer aided histopathological study has been conducted for various cancer detection and grading applications [51, 52].
The following Fig. (4). shows a microscopic view of the tissue sample stained with Hematoxylin and Eosin.
|Fig. (3). Steps involved in histopathological image analysis.|
|Fig. (4). Represents a benign and malignant histopathology image of oral cancer.|
Oral mucosa has typical epithelial architecture, a usual sub-epithelial region in a healthy and precancerous tissue sample (Fig. (4b)), whereas in OSCC abnormal epithelial, keratin region and keratin-pearl structures are observed (Fig. (4a)). Invasive or non-invasive forms of tissue samples may be analyzed from an epithelial area by distinguishing the basal epithelium layer. Sub-epithelial layer features suggest precancerous stages, such as OSF. Keratin with keratin-pearl area is quantified for classification of OSCC grading.
4. OVERVIEW OF MACHINE LEARNING MODELS
Machine Learning is the ability to obtain information through Artificial Intelligence (AI) systems. The following is a proper definition of what learning requires: “a computer program is said to learn from experience E with respect to some class of tasks T and performance measure P if its performance at tasks in T, as measured by P, improves with experience E” . Typically, machine learning algorithms are categorized into the following three types: supervised, unsupervised, and reinforcement learning.
(i) A dataset that includes a collection of features is provided for supervised learning algorithms. For each sample, labels or target values are also given. This mapping of features to target value labels is where the information is encoded. Once learned, it is predicted that the algorithm will determine the mapping of unseen sample features to their appropriate labels or target values.
(ii) In unsupervised learning, the aim is to obtain significant depictions and clarify the key features of the data. In this case, learning from the data does not include labels or target values.
(iii) An AI system interacts with a true or virtual environment in reinforcement learning algorithms. This provides feedback between the learning scheme and the interacting environment that is helpful in the task being learned to enhance efficiency.
The ML models i.e., Support Vector Machine (SVM), Artificial Neural Network (ANN), Decision Tree (DT), Naïve Bayes (BN), Random Forest (RF) and K-Nearest Neighbor (KNN), which are applied in this review for oral cancer prediction and diagnosis, are discussed. SVMs are widely used in the area of cancer research. Firstly, SVM maps the input vector into a higher dimensional feature space and separate the data points into two groups. This maximizes the marginal distance between the decision hyperplane and the instances nearest to the boundary. This classifier archives tremendous generalizability and can be used to accurately identify new samples. The hyperplane acts as the decision boundary between the two groups and detects any misclassification produced by the model.
In ANN, neural connections of multiple hidden layers are present. This model is considered as a gold standard method for many classification tasks, but has certain limitations. It is a time consuming technique due to the generic layered structure and considered as a “black-box”. It is difficult to detect how it is performing the classification.
DT is a tree-structured model where the input variables are represented by nodes and decision outcomes are the leaves. Depending on the structure of the DTs, they are easy to understand and widely used for many classifications tasks. When a new sample comes, the DT will be traversed for classification to speculate about its class.
BN classifiers generate conditional probability estimations. It is widely used in various tasks of knowledge discovery and reasoning due to a directed acyclic graph, which represents the probabilistic correlations amid the variables.
RF can be used for both classification and regression. It generates decision trees based on the data samples and then gets the predictions for each of them. The best solution is finally selected by the voting method. It provides better accuracy due to multiple decision trees predictions. This method works well on a large dataset with a large number of attributes.
KNN is a simple ML algorithm used for both classification and regression problems. It uses data points and identifies new data based on the measure of similarity (e.g. distance function). The classification of its neighbor is achieved by the majority vote.
Deep learning is a subset of machine learning that normally requires learning depictions at distinct levels of hierarchy to allow complex concepts to be constructed from more naive ones.
Machine learning algorithms require labeled data, complex queries involving huge amounts of data are not suitable for solving. The real application of deep learning is on a much larger scale.The following paragraphs discuss the most appropriate deep learning technologies currently available for various fields.
In the early 1980s, LeCun initially put forward the Convolutional Neural Network (CNN). It was further altered in the 1990s by LeCun and his associates . CNN is a deep, feed-forward artificial neural system that is essentially connected in visual patterns. CNN does the task of machine learning in the first part, like feature extraction, and learning, and thereafter pattern grouping.
CNN is predominantly scheduled for 2-D visual pattern recognition . It is widely accepted that CNN works perfectly for image problems and outperformed most of the other methods in image classification [56, 57] and segmentation tasks
Out of the different deep learning models (RNN, Autoencoder, DBN etc.), the CNN model is receiving a lot of attention in digital image processing and computer vision. There are various kinds CNN architectures, such as LeNet , AlexNet , ZFNet , VGGNet , GoogleNet [53, 60], Dense CNN , FractalNet , and Residual Network . LeCun et al. proposed LeNet, which was applied for handwriting recognition. AlexNet is widely used for object detections. After that ZFNet, VGGNet, and GoogleNet were put forward based on AlexNet [64-69].
Fig. (5) shows the difference between machine learning and deep learning. It also shows that traditional machine learning is dependent on the handcrafted features whereas deep learning extracts all coarse features just like a black box. Fig. (5a) represents the performance with respect to the amount of data for deep learning as well as machine learning. Traditional machine learning is giving a better performance with a small amount of datasets. If the quantity of data rises, after a certain stage, the efficiency of traditional approaches to machine learning becomes constant. The efficiency of deep learning methods, on the other hand, improved with regard to the increase in data volume.
|Fig. (5). Comparison of machine learning and deep learning in digital pathological image analysis.|
5. LITERATURE REVIEW
Rahman et al. (2017)  research analyzed texture based abnormalities that exist in oral squamous cell carcinoma by using histopathological slides. Histogram and Gray Level Co-occurrence Matrix (GLCM) methods were used with normal and malignant cells to extract texture features from biopsy images. They used linear SVM for automatic classification of oral cancer and obtained 100% accuracy.
Muthu et al. (2011)  proposed a method for “Textural characterization of histopathological images for oral sub-mucous fibrosis detection”. They used a combination of different features of wavelet family with SVM classifier that gave better accuracy.
Muthu et al. (2012b)  proposed “Automated oral cancer identification using histopathological images: a hybrid feature extraction paradigm”. They analyzed the texture features using HOS, LBP, and LTE and obtained an accuracy of 95.7% using the Fuzzy Classifier. Authors have shown the efficiency of Fuzzy classifier compared to DT, GMM, PNN, and KNN classifiers as the features extracted are accurate and efficient. Muthu et al. (2012a)  proposed a method for classification by using SVM and GMM classifier. With a very large pixel size image (1388x1040) and by applying different techniques, such as image pre-processing, segmentation, feature extraction and classification, SVM gives better results compared to other classifiers.
A study carried out by Anuradha. K et al. (2013)  is a method for statistical feature extraction for the detection of oral cancer. They used tumor detection by marker-controlled Wat- ershed segmentation. Energy, entropy, contrast, correlation, homogeneity are the characteristics obtained with Gray Level Co-occurrence Matrix (GLCM) through extraction. Using SVM classifiers, they acquired a precision of 92.5 percent.
Dev Kumar et al. (2015)  developed a model to detect the keratinization and keratin pearl areas from which the keratinization index was calculated. This Keratinization scoring index can be used as a quantitative measure for OSCC for even very low (4x) magnification. Again Dev Kumar et al. (2018)  proposed a method for “automatic identification of clinically relevant regions from oral tissue histological images for oral squamous cell carcinoma”. They used 12 layered deep convolution neural network (CNN) for the segmentation of different layers, such as keratin, epithelial, and subepithelial. From the segmented keratin regions, keratin pearls were detected with the texture based feature (Gabor filter) and random forest classifier, which gives 96.88% accuracy.
T.Belvin et al. (2013)  used backpropagation based ANN for multi-class classification of oral lesions by using run-length features and texture features. The proposed model aims for a more illustrative and patient-specific approach by using a combination of GLCM and GLRL features with an accuracy of 97.92%.
The above studies represent the recent work done for the prognosis and prediction of oral cancer using machine learning techniques. A systematic analysis is performed about the use of ML techniques for oral cancer. Depending upon the search criteria about the oral cancer prognosis, a large number of articles were obtained. A substantial rise in the number of papers published over the last ten years was noticed. Most of these studies use or combine various datasets: genomics, clinical, histopathological, biological, demographic, epidemiological data, etc. Papers based on predicting the development of oral cancer by traditional statistical approaches (e.g. chi-square, t-test) were excluded from this study. Though a full coverage of the literature cannot be achieved, the most recent and relevant publications those use ML techniques were filtered out and included in this study.
From Table 1. authors claimed that using ML techniques for the classification of oral lesion results in adequate and effective decision making. Among the different ML algorithms used for the oral cancer prediction, it was found that SVM classifier is more used due to its accurate predictive efficiency. Apart from SVM, other ML Techniques such as ANN, Decision tree, Random forest, and KNN are used. For evaluation purposes, mainly ten-fold cross validation was used after the execution of each ML process. Furthermore, accuracy, sensitivity, and specificity were also measured. The authors analyzed the ROC curve for evaluation purposes.
|Author||Images used||Features||Classifier||Performance measure||Results||Findings|
|Muthu et al. (2012a) ||Normal-341 OSF-429 images obtained from more than 20 patients.
Source: School of medical science and technology, Kharagpur
|Morphological and textural features||SVM
|Classifies the images into Normal, OSFWD, and OSFD||Image pre-processing, segmentation, feature extraction, and classification gives a very effective result with SVM.|
|Muthu et al. (2012b) ||Normal-90
Source: “School of medical science and technology, Kharagpur”
|Classifies the images into Normal, OSFWD, and OSFD||Out of different classifiers fuzzy gives promising performance because it can manage imprecise non-linear parameters when supplied with a mixture of texture and HOS function.|
|Muthu et al. (2011) ||Normal-90
Source:” School of medical science and technology, Kharagpur”
|71 features of wavelet family(LBP,Gabor, BMC)||SVM||Accuracy (88.38%)||Classifies the images into Normal, OSFWD, and OSFD||A combination of different features of wavelet family gives better accuracy than when tested individually.|
|Anuradha. K. et al.2013 ||-||Energy, entropy,
|SVM||Accuracy (92.5%)||The classifier gives the result of the tumor as benign or malignant||SVM with GLCM features gives better results.|
|T.Belvin et al.(2013) ||16 malignant images with 192 patches were collected from Himalayan Iinstitute of medical institute, Deradun||Texture features and Run Length features||Backpropagation based ANN||Accuracy (97.92%)||The combination of GLCM and GLRL features are used for the multiclass classification of oral lesions.||The proposed model aims for more illustrative and patients specific approach with
ANN-based multiclass classification.
|D.Dev kumar et al.(2015) ||10 OSCC patients with 30 labelled images were collected from Tata medical centre, Kolkata||Keratinization and keratin pearls||Keratinization scoring index||Segmentation accuracy (95.08%)||Keratinization and keratin pearls were detected by keratinization index (CKI) to grade the OSCC into I,II,III.||Keratinization scoring index can be used as a quantitative measure for OSCC for even very low (4x) magnification.|
|Rahman et al. (2017) ||Center-1 Normal-110
Source:”Ayursundra healthcare pvt Ltd and Dr. B Borooah cancer Research institute”
mean, variance, energy, entropy etc.
|SVM||Accuracy (100%)||The images are classified as normal or malignant||Image size (2048x1536) and magnification of 400x gives very high performance.|
|D.Dev kumar et al.(2018) ||High grade-15
Total 126 images
collected from “Barasat Cancer Research & Welfare Centre, Barasat, WB, India”
|Identification of various layers –epithelial,subepithelial, keratin region and keratin pearls||CNN,
|Accuracy (96.88%)||Different layers of oral mucosa such as epithelial, subepithelial, and keratin and keratin pearl are identified by segmentation.||Two stage CNN for segmentation gives better prediction and outcome with valid accuracy.|
All of the studies achieved very promising results. Moreover, the selection of the most suitable algorithm depends on several parameters like types of data obtained, dataset size, time limits, and the quality of predictive performance.
A common limitation from the studies included in this review is the small size of the dataset. To model a disease classification scheme, a sufficiently large training dataset is required so that proper partitioning of training and testing sets can be made for accurate validation. Apart from the dataset size, the dataset quality and appropriate feature selection procedure are important for accurate and effective cancer prediction.
Since the team's overwhelming success with deep learning at the 2012 ImageNet Large Scale Visual Recognition Competition (ILSVRC), most image recognition methods have been substituted by deep learning (Krizhevsky et al. ). In Table 1, although several works on oral cancer has been proposed using machine learning techniques, very less work has been performed using deep learning for histopathological image analysis. Table 3 demonstrates the histopathological analysis of other cancer types using deep learning and Table 2 includes the research performed for oral cancer using heterogeneous data types. Even though these works do not fit in with the general statement of histopathological image analysis of oral cancer, it was decided to include them in this study due to the efficient models developed using heterogeneous data types in the field of oral cancer diagnosis. In Table 3, the wide applicability of histopathological analysis of other types of cancer is highlighted. To overcome the limitations mentioned above and the wide spread use of deep learning models for prediction in cancer domain, researchers can develop new methods by using deep learning techniques for oral cancer to achieve accurate disease outcomes. A large number of valid publicly available datasets of oral cancer can be analyzed for future cancer prediction.
Table 2 represents the different types of work done by taking heterogeneous type of data, such as clinical, genomic, molecular, etc. Some related work performed using machine learning methods for oral cancer based on this study are presented. Regarding the output, the authors claimed that the BN classifier performs better with the direct input of the integration of mixed data. BN classifier is very fast and easy to implement. SVM classifier outperforms with the combination of a clinical and molecular dataset. Complex features are learned by the kernels of SVM, however, they are very slow. Halicek M et al. (2016) and Shams W.K. et al. (2016) used the deep learning models for oral cancer prognosis with hyperspectral imaging and gene expression datasets. Remmerbach, T.W et al. used SVM classifier for the oral cancer diagnosis using matrix-assisted-laser-desorption/ ionisation-time-of-flight-mass-spectrometry mass spectrometry with 100% sensitivity and 93% specificity. Their screening method is done by a brush biopsy, which is less invasive compared to the conventional histology biopsy. Ashizawa, K et al. performed probe electrospray ionization mass spectrometry analysis of head and neck by using partial least square –logistic regression technique. The authors claimed that their method could diagnose head and neck SCC more accurately and rapidly compared to the time consuming procedure of slide preparation then microscopic assessment of pathological diagnosis. Therefore, this mass spectrometry is considered as a powerful label-free tool to analyze the molecular species, such as proteins, peptide, glycans, metabolites, etc., from a variety of biological samples. Authors have proved the efficiency of their models by comparing them with other conventional state-of-the-art models. Deep learning models have their own advantages compared to machine learning.
|Publication||Method||Cancer type||Type of data||Accuracy|
|Rosado P et al.(2013) ||SVM||Oral cancer||Clinical, molecular||98%|
|Chang S-W et al.(2013) ||SVM||Oral cancer||Genomic, Clinical||75%|
|Exarchos K et al.(2012) ||BN||Oral cancer||Imaging, Clinical, tissue genomic, blood genomic||100%|
|Halicek M et al.(2016) ||CNN||Head and Neck||Hyperspectral Imaging||96.4%|
|Shams W.K. et al.(2016) ||DNN||Oral cancer||Gene expression||96%|
|Remmerbach, T.W et al.(2011) ||SVM||Oral cancer||Mass Spectrometry||Sensitivity=100%
|Ashizawa, K et al.(2017) ||Partial least squares-logistic regression||Head and Neck||Mass Spectrometry||Positive-ion mode ACC=90.48% Negative–ion mode ACC=95.35%|
|Xu et al.(2014) ||Multiple instance learning framework with CNN features||Colon Cancer||Patch level classification|
|Bychkov et al.(2016) ||Extracted CNN features from epithelial tissue||Colorectal cancer||Outcome prediction of the cancer|
|Litjens et al. (2016) ||fCNN based pixel classifier||Prostate and Breast cancer||Detection of Prostate and Breast cancer|
|Harsitha S.et al. (2017) ||AlexNet||Abdomen Cancer||Cancer classification and necrosis detection|
|Li W et al.(2018) ||Region based CNN||Prostate cancer||Epithelial cells detection and Gleason grading|
|Asami Y et al.(2017) ||Deep CNN||Brain Tumor||Grading disease stages|
|Neeraj K et al.(2017) ||Two separate CNN||Prostate cancer||Detection of individual nuclei and classification|
|Harsitha S.et al(2016) ||CNN||Abdomen cancer||Cancer classification based on immunohistochemistry and necrosis detection|
|Atsushi T.et al.(2017) ||Deep CNN||Lung Cancer||Accurate classification of cancer types.|
|Shidan W.et al.(2018) ||Deep CNN||Lung Cancer||Automated tumor recognition system|
|Teresa A.et al.(2017) ||CNN and SVM||Breast cancer||Four classes of cancer classification|
|Alexander R.et al.(2018) ||Deep CNN and gradient boosted tree||Breast cancer||Four classes and two of classification|
|Md Zahangir et al.(2018) ||IRRCNN(Inception Recurrent Residual CNN)||Breast cancer||Cancer classification and comparison with other models|
|M.M. Al Rahhal(2018) ||Deep CNN||Breast cancer||Detection and classification|
Table 3 represents different types of cancer detection and classification done by deep learning models using histopathological images. Mostly different CNN architectures are used for the wide area of cancer types such as lung, breast, brain, prostate, colon and colorectal cancer. This indicates the broad applicability of deep learning models in the various fields of cancer. Apart from these, deep learning can be applied to almost all areas. Some example applications are, object localization, object detection, image or video captioning , media and entertainment, image or video segmentation, autonomous car [95, 96], machine translation, speech recognition , security and defence [98, 99], vehicle classification , medicine and biology. There are also other challenging problems that have been resolved during the last few years, which could not be efficiently solved before this DL revolution. There are some recently conducted surveys in this area [100-102]. These documents investigate deep learning and its revolution.
In this study, the usefulness of machine learning and deep learning algorithms in different histopathological image analysis tasks, especially in oral cancer, was observed. The machine learning and deep learning algorithms were compared with diverse concerns in section 4. After studying the last nine years (2010-2018) of histopathological image analysis research work in computer vision for detecting various cancers, it was realized from the finding that the outcome of deep learning networks performs better compared to other traditional machine learning algorithms for handling complex queries. Within this period, there has been a rapid increase in several research studies using artificial intelligence techniques. Considering the number of layers, hierarchies, and concepts processed by the deep learning models, they are only suitable for carrying out complex calculations rather than simpler ones. The quality of data fed to the deep learning model determines the quality of the result. Because of the nested layers in the deep neural networks, these models do not require human intervention. Data are put through different layers of hierarchies and they can learn by their own errors, thus reducing the explicit intervention on the data engineering(pre-processing) process. In Table 1, although the findings indicated a very excellent efficiency in the prediction of oral cancer, they used very less number of samples (in the range of 10 to 110) for their study. Therefore, in the case of machine learning, an increase in the number of study samples is expected to affect the outcome and reduce the efficiency of the model and human intervention is required to retrain the model if the actual outcome is not the desired one.
A great deal of effort is currently being made to find effective methods to carry out unsupervised learning, as large quantities of unlabeled information are now becoming less costly, economically and technologically. Achievement in this goal will enable algorithms to know how the world operates by just watching it as we humans do.
Furthermore, real-world issues that generally involve high-dimensional ongoing state spaces (large number of states and/or actions) can make the issue intractable with present methods, severely restricting actual application growth. As an unsolved challenge, an effective way to cope with these kinds of issues continues.
Due to the capability of deep learning to execute feature engineering on its own, data scientists can save months of work for extracting the features from raw data. In deep learning, the data are scanned to look for features that correlate and combine them to allow faster learning without being specifically told to.
6.1. Challenges of Deep Learning
Deep learning approaches often face several challenges, starting with their own theoretical knowledge. An example of this is the lack of knowledge about the structure of the objective function in deep neural networks or why some architectures perform better than others.
There is a general absence of publicly accessible information in medical image analysis, and rare information labeled with high quality. Fewer than 100 patients are involved in the majority of the data sets described in this oral cancer evaluation. The articles in this survey report give good performance in the different assignments despite the small training data sets. Cho et al.  explained how many images are needed to train for medical image analysis problems. As a rule, data scientists say that “the more powerful abstraction you want, the more data is required”.
In medical image analysis, less training data or class inequality in the training set is also a major issue . If appropriate quantities of training samples are not used, this may result in overfitting. Data inequality can be enhanced by using data augmentation [56, 64] to produce extra unusual image training samples, although there is a risk of overfitting.
In image recognition tasks, AI algorithms have outper- formed human execution and can deliver superior performance in medical image analysis to individuals. However, the issue occurs when a patient is misdiagnosed due to AI or AI-helped restorative administration or endures hopelessness. This is complemented by the failure to completely clarify how the black box of deep learning algorithms works.
6.2. Future Direction
In the section of literature review, the traditional machine learning applications for medical image analysis have been discussed.
The upcoming research areas include prognostication , content-based image retrieval [106, 107], caption generation [108, 109], and manipulation of physical objects with LSTMs and reinforcement learning [110, 111], involving surgical robots [112, 113].
These models highlight how the field of AI is quickly changing in medical image analysis and that numerous apps that have not yet been established may still exist. Thus, AI research area is very wide and needs further investigation. Further research is required in the following areas.
(1) Focusing more on adaptive dynamic programming (ADP) could produce a remarkable finding that accounts for more important brain research and computational intelligence.
(2) It would be interesting to construct deep learning models that can learn from fewer training data to make the prediction.
(3) Parameter tuning in AI is an emerging topic. Therefore, the effective use of the network variable’s optimization algorithms should be well studied.
(4) Research on the opportunities of integrating neural networks with other techniques that exist or develop.
(5) Hybrid neural network models should be developed for better efficiency and effectiveness.
Applications of different machine learning, as well as deep learning techniques highlighting the role of neural networks, are briefly discussed in this paper. Many methods are studied to classify images into distinct phases of cancer.
For getting enhanced performance, the use of increased dataset, selection, and extraction of appropriate features and combination of specified techniques may give adequate results. The proficiency of SVM is proved to be significant for different types of features showing its robustness in multiple fields. But it is a machine learning approach in which handcrafted features are fed to the model and works well for less number of the dataset. Mostly, CNN of deep learning works in an ideal way for image problems by doing the simultaneous work of feature extraction and classification. Implicit feature engineering and faster learning approach of CNN makes it possible to outperform in prediction /prognosis in the cancer domain. Finally, it can be said that CNN can work with a very large and different types of datasets to obtain closer to perfect results.
A more extensive review of deep learning methods within histopathology can be carried out for future work.
CONSENT FOR PUBLICATION
CONFLICT OF INTEREST
The authors declare no conflict of interest, financial or otherwise.
The authors thank reviewers of this work for their valuable comments and suggestions that improve the presentation of this research effort.
|||Hanahan D, Weinberg RA. Hallmarks of cancer: the next generation. Cell 2011; 144(5): 646-74.
|||Leung F, Eberlin LS, Schwamborn K, Heeren RMA, Winograd N, Cooks RG. Mass spectrometry-based tissue imaging: the next frontier in clinical diagnostics? Clin Chem 2019; 65(4): 510-3.
|||Ifa DR, Eberlin LS. Ambient ionization mass spectrometry for cancer diagnosis and surgical margin evaluation. Clin Chem 2016; 62(1): 111-23.
|||Porcari AM, Zhang J, Garza KY, et al. Multicenter study using desorption-electrospray-ionization-mass-spectrometry imaging for breast-cancer diagnosis. Anal Chem 2018; 90(19): 11324-32.
|||Tata A, Gribble A, Ventura M, et al. Wide-field tissue polarimetry allows efficient localized mass spectrometry imaging of biological tissues. Chem Sci (Camb) 2016; 7(3): 2162-9.
|||Woolman M, Tata A, Bluemke E, Dara D, Ginsberg HJ, Zarrine-Afsar A. An assessment of the utility of tissue smears in rapid cancer profiling with desorption electrospray ionization mass spectrometry (DESI-MS). J Am Soc Mass Spectrom 2017; 28(1): 145-53.
|||Tata A, Woolman M, Ventura M, et al. Rapid detection of necrosis in breast cancer with desorption electrospray ionization mass spectrometry. Sci Rep 2016; 6: 35374.
|||Ristevski B, Chen M. Big data analytics in medicine and healthcare. J Integr Bioinform 2018; 15(3)
|||Gurcan MN, Boucheron LE, Can A, Madabhushi A, Rajpoot NM, Yener B. Histopathological image analysis: a review. IEEE Rev Biomed Eng 2009; 2: 147-71.
|||Onder D, Sarioglu S, Karacali B. Automated labelling of cancer textures in colorectal histopathology slides using quasi-supervised learning. Micron 2013; 47: 33-42.
|||Unsupervised segmentation and classification of cervical cell images. Pattern Recognit 2012; 45(12): 4151-68.
|||Ojansivu V, Linder N, Rahtu E, et al. Automated classification of breast cancer morphology in histopathological images. Diagn Pathol 2013; 8(1): S29.
|||Patel JL, Goyal RK. Applications of artificial neural networks in medical science. Curr Clin Pharmacol 2007; 2(3): 217-26.
|||Cireşan DC, Giusti A, Gambardella LM, Schmidhuber J. Mitosis detection in breast cancer histology images with deep neural networks. International Conference on Medical Image Computing and Computer-assisted Intervention 411-8.
|||Zhuo L, Jiang L, Zhu Z, Li J, Zhang J, Long H. Vehicle classification for large-scale traffic surveillance videos using convolutional neural networks. Mach Vis Appl 2017; 28(7): 793-802.
|||Lim LAG, Maguib RN, Dadios EP, Avila JMC. Implementation of GA-KSOM and ANFIS in the classification of colonic histopathological imagesTENCON 2012 IEEE Region 10 Conference 2012; 1-5.
|||Li C, Zhang S, Zhang H, et al. Using the K-nearest neighbor algorithm for the classification of lymph node metastasis in gastric cancer. Comput Math Methods Med 2012; 2012876545
|||Chen G, Zhang J, Zhuo D, Pan Y, Pang C. Identification of pulmonary nodules via CT images with hierarchical fully convolutional networks. Med Biol Eng Comput 2019; 57(7): 1567-80.
|||Sertel O, Kong J, Shimada H, Catalyurek UV, Saltz JH, Gurcan MN. Computer-aided prognosis of neuroblastoma on whole-slide images: Classification of stromal development. Pattern Recognit 2009; 42(6): 1093-103.
|||Kumagai S, Hotta K, Kurita T. Mixture of counting CNNs. Mach Vis Appl 2018; 29(7): 1119-26.
|||Tharaha S, Rashika K. Hybrid artificial neural network and decision tree algorithm for disease recognition and prediction in human blood cells. 2017; International Conference on Innovations in Information, Embedded and Communication Systems (ICIIECS) 1-5.
|||Pershin YV, Di Ventra M. Experimental demonstration of associative memory with memristive neural networks. Neural Netw 2010; 23(7): 881-6.
|||Lo JTH. Functional model of biological neural networks. Cogn Neurodyn 2010; 4(4): 295-313.
|||Keller JM, Gray MR, Givens JA. A fuzzy k-nearest neighbor algorithm. IEEE Trans Syst Man Cybern 1985; (4): 580-5.
|||LeCun Y, Huang FJ, Bottou L. 2: pp Learning methods for generic object recognition with invariance to pose and lighting 2004; 97-104.
|||Jain V, Murray JF, Roth F, et al. Supervised learning of image restoration with convolutional networks. 2007.
|||Jain V, Seung S. Natural image denoising with convolutional networks. Advances in neural information processing systems 2009; 769-.|
|||Malon C, Miller M, Burger HC, Cosatto E, Graf HP. Identifying histological elements with convolutional neural networks. Proceedings of the 5th international conference on Soft computing as transdisciplinary science and technology 450-6.
|||Wang H, Cruz-Roa A, Basavanhally A, et al. International Society for Optics and PhotonicsCascaded ensemble of convolutional neural networks and handcrafted features for mitosis detection. Medical Imaging 2014; 90410B.|
|||Rosado P, Lequerica-Fernández P, Villallaín L, Peña I. SanchezLasheras F, De Vicente JC. Survival model in oral squamous cell carcinoma based on clinicopathological parameters, molecular markers and support vector machines. Expert Syst Appl 2013; 40(12): 4770-6.
|||Chang SW, Abdul-Kareem S, Merican AF, Zain RB. Oral cancer prognosis based on clinicopathologic and genomic markers using a hybrid of feature selection and machine learning methods. BMC Bioinformatics 2013; 14(1): 170.
|||Exarchos KP, Goletsis Y, Fotiadis DI. Multiparametric decision support system for the prediction of oral cancer reoccurrence. IEEE Trans Inf Technol Biomed 2012; 16(6): 1127-34.
|||Stojadinovic A, Nissan A, Eberhardt J, Chua TC, Pelz JO, Esquivel J. Development of a Bayesian Belief Network Model for personalized prognostic risk assessment in colon carcinomatosis. Am Surg 2011; 77(2): 221-30.
|||Tseng CJ, Lu CJ, Chang CC, Chen GD. Application of machine learning to predict the recurrence-proneness for cervical cancer. Neural Comput Appl 2014; 24(6): 1311-6.
|||Anuradha K, Sankaranarayanan K. Detection of Oral Tumors using Marker Controlled Segmentation. Int J Comput Appl 2012; 52(2): 15-8.|
|||Tissue PFH. What Exactly Happens http://bitesizebio.com/ 13469/tissue-processing-for-histology-whatexactly-happens/2015|
|||Exarchos KP, Goletsis Y, Fotiadis DI. Unification of heterogeneous data towards the prediction of oral cancer reoccurrence.George Potamias Vassilis Moustakis 2009; 21.|
|||National Institute of Public Health. 2011.|
|||Rosenberg D, Cretin S. Use of meta-analysis to evaluate tolonium chloride in oral cancer screening. Oral Surg Oral Med Oral Pathol 1989; 67(5): 621-7.
|||Mashberg A, Samit A. Early diagnosis of asymptomatic oral and oropharyngeal squamous cancers. CA Cancer J Clin 1995; 45(6): 328-51.
|||Epstein JB, Oakley C, Millner A, Emerton S, van der Meij E, Le N. The utility of toluidine blue application as a diagnostic aid in patients previously treated for upper oropharyngeal carcinoma. Oral Surg Oral Med Oral Pathol Oral Radiol Endod 1997; 83(5): 537-47.
|||Sciubba JJ. Improving detection of precancerous and cancerous oral lesions. Computer-assisted analysis of the oral brush biopsy. U.S. Collaborative OralCDx Study Group. J Am Dent Assoc 1999; 130(10): 1445-57.
|||Epstein JB, Zhang L, Poh C, Nakamura H, Berean K, Rosin M. Increased allelic loss in toluidine blue-positive oral premalignant lesions. Oral Surg Oral Med Oral Pathol Oral Radiol Endod 2003; 95(1): 45-50.
|||National Cancer Institute. SEER cancer statistics review 1975–2003 2003.|
|||Tsantoulis PK, Kastrinakis NG, Tourvas AD, Laskaris G, Gorgoulis VG. Advances in the biology of oral cancer. Oral Oncol 2007; 43(6): 523-34.
|||Yeole BB, Ramanakumar AV, Sankaranarayanan R. Survival from oral cancer in Mumbai (Bombay), India. Cancer Causes Control 2003; 14(10): 945-52.
|||Acha A, Ruesga MT, Rodríguez MJ, Martínez de Pancorbo MA, Aguirre JM. Applications of the oral scraped (exfoliative) cytology in oral cancer and precancer. Med Oral Patol Oral Cir Bucal 2005; 10(2): 95-102.
|||Available at: https://www.who.int/oral_health/publications/cancer_ maps/en/|
|||Available at: https://oralcancerfoundation.org/facts/|
|||Akhter M, Hossain S, Rahman QB, Molla MR. A study on histological grading of oral squamous cell carcinoma and its co-relationship with regional metastasis. J Oral Maxillofac Pathol 2011; 15(2): 168-76.
|||Wang D, Khosla A, Gargeya R, Irshad H, Beck AH. Deep learning for identifying metastatic breast cancer. arXiv preprint arXiv 2016.|
|||Wang D, Foran DJ, Ren J, Zhong H, Kim IY, Qi X. Exploring automatic prostate histopathology image gleason grading via local structure modeling. 2015.
|||Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, et al. Going deeper with convolutions. Proceedings of the IEEE conference on computer vision and pattern recognition 1-9.|
|||LeCun Y, Boser B, Denker JS, et al. Backpropagation applied to handwritten zip code recognition. Neural Comput 1989; 1(4): 541-51.
|||Habibi Aghdam Hamed, Jahani Heravi Elnaz. Guide to convolutional neural networks 2017; 978-3.|
|||Krizhevsky A, Sutskever I, Hinton GE. Imagenetclassification with deep convolutional neural networks. Advances in neural information processing systems 2012; 1097-5.|
|||Remmerbach TW, Maurer K, Janke S, et al. Oral brush biopsy analysis by matrix assisted laser desorption/ionisation-time of flight mass spectrometry profiling--a pilot study. Oral Oncol 2011; 47(4): 278-81.
|||Zeiler MD, Fergus R. Visualizing and understanding convolutional networks. European conference on computer vision 818-33.
|||Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition arXiv preprint arXiv:14091556 2014.|
|||Szegedy C, Ioffe S, Vanhoucke V, Alemi AA. Inception-v4, inceptionresnet and the impact of residual connections on learning. Thirty-First AAAI Conference on Artificial Intelligence|
|||Larsson G, Maire M, Shakhnarovich G. Fractalnet: Ultra-deep neural networks without residuals. arXiv preprint arXiv:160507648 2016.|
|||He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. Proceedings of the IEEE conference on computer vision and pattern recognition 770-8.|
|||Suk HI, Lee SW, Shen D. Latent feature representation with stacked auto-encoder for AD/MCI diagnosis. Brain Struct Funct 2015; 220(2): 841-59.
|||Miki Y, Muramatsu C, Hayashi T, et al. Classification of teeth in cone-beam CT using deep convolutional neural network. Comput Biol Med 2017; 80: 24-9.
|||Cheng G, Zhou P, Han J. Learning rotation-invariant convolutional neural networks for object detection in VHR optical remote sensing images. IEEE Trans Geosci Remote Sens 2016; 54(12): 7405-15.
|||Girshick R, Donahue J, Darrell T, Malik J. Region-based convolutional networks for accurate object detection and segmentation. IEEE Trans Pattern Anal Mach Intell 2016; 38(1): 142-58.
|||Hu F, Xia GS, Hu J, Zhang L. Transferring deep convolutional neural networks for the scene classification of high-resolution remote sensing imagery. Remote Sens 2015; 7(11): 14680-707.
|||Alom MZ, Taha TM, Yakopcic C, et al. The history began from alexnet: A comprehensive survey on deep learning approaches. arXiv preprint arXiv:180301164 2018.|
|||Yu H, Wang J, Huang Z, Yang Y, Xu W. Video paragraph captioning using hierarchical recurrent neural networks. Proceedings of the IEEE conference on computer vision and pattern recognition 4584-93.
|||Muthu Rama Krishnan M, Chakraborty C, Paul RR, Ray AK. Hybrid segme-ntation, characterization and classificationof basel cell nuclei from histopathological images of normal oral mucosa and submucous fibrosis. Expert Syst Appl 2012; 39: 1062-77. [a].
|||Krishnan MMR, Venkatraghavan V, Acharya UR, et al. Automated oral cancer identification using histopathological images: a hybrid feature extraction paradigm. Micron 2012; 43(2-3): 352-64.
|||Krishnan MM, Shah P, Choudhary A, Chakraborty C, Paul RR, Ray AK. Textural characterization of histopathological images for oral sub-mucous fibrosis detection. Tissue Cell 2011; 43(5): 318-30.
|||Thomas B, Kumar V, Saini S. Texture analysis based segmentation and classification of oral cancer lesions in color images using ANN. 2013; IEEE International Conference on Signal Processing, Computing and Control (ISPCC) 1-5.
|||Das DK, Chakraborty C, Sawaimoon S, Maiti AK, Chatterjee S. Automated identification of keratinization and keratin pearl area from in situ oral histological images. Tissue Cell 2015; 47(4): 349-58.
|||Rahman TY, Mahanta LB, Chakraborty C, Das AK, Sarma JD. Textural pattern classification for oral squamous cell carcinoma. J Microsc 2018; 269(1): 85-93.
|||Das DK, Bose S, Maiti AK, Mitra B, Mukherjee G, Dutta PK. Automatic identification of clinically relevant regions from oral tissue histological images for oral squamous cell carcinoma diagnosis. Tissue Cell 2018; 53: 111-9.
|||Halicek M, Lu G, Little JV, et al. Deep convolutional neural networks for classifying head and neck cancer using hyperspectral imaging. J Biomed Opt 2017; 22(6): 60503.
|||Shams WK, Htike ZZ. Oral cancer prediction using gene expression profiling and machine learning. Int J Appl Eng Res 2017; 12: 4893-8.|
|||Ashizawa K, Yoshimura K, Johno H, et al. Construction of mass spectra database and diagnosis algorithm for head and neck squamous cell carcinoma. Oral Oncol 2017; 75: 111-9.
|||Xu Y, Jia Z, Wang LB, et al. Large scale tissue histopathology image classification, segmentation, and visualization via deep convolutional activation features. BMC Bioinformatics 2017; 18(1): 281.
|||Bychkov D, Turkki R, Haglund C, Linder N, Lundin J. International Society for Optics and PhotonicsDeep learning for tissue microarray image-based outcome prediction in patients with colorectal cancer. Medical Imaging 2016: Digital Pathology 979115 2016; 9791|
|||Litjens G, Sánchez CI, Timofeeva N, et al. Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis. Sci Rep 2016; 6: 26286.
|||Sharma H, Zerbe N, Klempert I, Hellwich O, Hufnagl P. Deep convolutional neural networks for automatic classification of gastric carcinoma using whole slide images in digital histopathology. Comput Med Imaging Graph 2017; 61: 2-13.
|||Li W, Li J, Sarma KV, et al. Path R-CNN for prostate cancer diagnosis and gleason grading of histological images. IEEE Trans Med Imaging 2019; 38(4): 945-54.
|||Yonekura A, Kawanaka H, Prasath VS, Aronow BJ, Takase H. Glioblastoma multiforme tissue histopathology images based disease stage classification with deep CNN. 2017 6th International Conference on Informatics, Electronics and Vision & 2017 7th International Symposium in Computational Medical and Health Technology (ICIEV-ISCMHT) 2017; 1-5.
|||Kumar N, Verma R, Arora A, et al. International Society for Optics and PhotonicsConvolutional neural networks for prostate cancer recurrence prediction. Medical Imaging 2017; 10140: 101400H..|
|||Sharma H, Zerbe N, Klempert I, Hellwich O, Hufnagl P. Deep convolutional neural networks for histological image analysis in gastric carcinoma whole slide images. Diagn Pathol 2016; 1(8)|
|||Teramoto A, Tsukamoto T, Kiriyama Y, Fujita H. Automated classification of lung cancer types from cytological images using deep convolutional neural networks. BioMed Res Int 2017; 20174067832
|||Wang S, Chen A, Yang L, et al. Comprehensive analysis of lung cancer pathology images to discover tumor shape and boundary features that predict survival outcome. Sci Rep 2018; 8(1): 10393.
|||Araújo T, Aresta G, Castro E, et al. Classification of breast cancer histology images using Convolutional Neural Networks. PLoS One 2017; 12(6)e0177544
|||Rakhlin A, Shvets A, Iglovikov V, Kalinin AA. Deep convolutional neural networks for breast cancer histology image analysis. International Conference Image Analysis and Recognition 737-44.
|||Alom MZ, Yakopcic C, Nasrin MS, Taha TM, Asari VK. Breast cancer classification from histopathological images with inception recurrent residual convolutional neural network. J Digit Imaging 2019; 32(4): 605-17.
|||Al Rahhal MM. Breast cancer classification in histopathological images using convolutional neural network. Breast Cancer 2018; 9(3)|
|||Sze V, Chen YH, Yang TJ, Emer JS. Efficient processing of deep neural networks: A tutorial and survey. Proc IEEE 2017; 105(12): 2295-329.
|||Rao Q, Frtunikj J. Deep learning for self-driving cars: chances and challenges. 2018.
|||Al-Qizwini M, Barjasteh I, Al-Qassab H, Radha H. Deep learning algorithm for autonomous driving using googlenet. 2017; IEEE Intelligent Vehicles Symposium (IV) 89-96.
|||Afouras T, Chung JS, Senior A, Vinyals O, Zisserman A. Deep audiovisual speech recognition. IEEE Trans Pattern Anal Mach Intell 2018.
|||Thananjeyan B, Garg A, Krishnan S, Chen C, Miller L, Goldberg K. 2017; IEEE International Conference on Robotics and Automation (ICRA) 2371-8.|
|||Seita D, Krishnan S, Fox R, McKinley S, Canny J, Goldberg K. Fast and reliable autonomous surgical debridement with cable-driven robots using a two-phase calibration procedure. 2018; IEEE International Conference on Robotics and Automation (ICRA) 6651-8.
|||Zhang Y, Deng Q, Liang W, Zou X. An efficient feature selection strategy based on multiple support vector machine technology with gene expression data. BioMed Res Int 2018; 20187538204
|||Rawat W, Wang Z. Deep convolutional neural networks for image classification: A comprehensive review. Neural Comput 2017; 29(9): 2352-449.
|||Huang G, Liu Z, Van Der Maaten L, Weinberger KQ. Densely connected convolutional networks. Proceedings of the IEEE conference on computer vision and pattern recognition 4700-8.|
|||Cho J, Lee K, Shin E, Choy G, Do S. How much data is needed to train a medical image deep learning system to achieve necessary high accuracy?. arXiv preprint arXiv:151106348 2015.|
|||Mazurowski MA, Habas PA, Zurada JM, Lo JY, Baker JA, Tourassi GD. Training neural network classifiers for medical decision making: the effects of imbalanced datasets on classification performance. Neural Netw 2008; 21(2-3): 427-36.
|||Liu X, Tizhoosh HR, Kofman J. Generating binary tags for fast medical image retrieval based on convolutional nets and radon transform. 2016; International Joint Conference on Neural Networks (IJCNN) 2872-8.
|||Anavi Y, Kogan I, Gelbart E, Geva O, Greenspan H. International Society for Optics and Photonics2016; 9785Visualizing and enhancing a deep learning framework using patients age and gender for chest x-ray image retrieval. Medical Imaging : 978510.|
|||Wang X, Lu L, Shin HC, et al. Unsupervised category discovery via looped deep pseudo-task optimization using a large scale radiology image database arXiv preprint arXiv:160307965 2016.|
|||Duan Y, Andrychowicz M, Stadie B, Ho OJ, Schneider J, Sutskever I, et al. One-shot imitation learning. Advances in neural information processing systems 2017; 1087-98.|
|||Levine S, Finn C, Darrell T, Abbeel P. End-to-end training of deep visuomotor policies. J Mach Learn Res 2016; 17(1): 1334-73.|
|||Bakker B. Reinforcement learning with long short-term memory. Advances in neural information processing systems 2002; 1475-82.|
|||Parisotto E, Salakhutdinov R. Neural map: Structured memory for deep reinforcement learning arXiv preprint arXiv:170208360 2017.|
|||Le HM, Do TN, Phee SJ. A survey on actuators-driven surgical robots. Sens Actuators A Phys 2016; 247: 323-54.
|||York PA, Swaney PJ, Gilbert HB, Webster RJ. A wrist for needlesized surgical robots. 2015; IEEE International Conference on Robotics and Automation (ICRA) 1776-81.