###Evaluation metrics: Accuracy Precision, Recall Area under ROC R-squared: R-squared, also known as the coefficient of determination, is a statistical measure used in regression analysis to assess the goodness of fit of a model. Essentially, it indicates the proportion of the variance in the dependent variable that is predictable from the independent variable(s). Mean average precision (MAP) Mean reciprocal rank Equal Error rate: For biometric systems - authentication.. Binary. he Equal Error Rate is the point where the False Acceptance Rate (FAR) and the False Rejection Rate (FRR) are equal. In other words, it is the operating point where the system makes an equal number of errors in falsely accepting legitimate users (FAR) and falsely rejecting authorized users (FRR). Lower: better performance A/B testing fundamentals Supervised Learning Linear & Logistic regression Naive Bayes classifier Bagging & Boosting K-nearest neighbors Trees Neural Networks Support Vector Machines Random Forests, Gradient Boosted trees, kernel methods, Stochastic Gradient Descent (SGD), Sequence Modeling, Bayesian linear regression, Gaussian Processes, Concepts of overfitting and under fitting, Regularization and evaluation metrics for classification and regression problems Unsupervised Learning Clustering algorithms, k-Means clustering, Anomaly detection, Markov methods, DBSCAN, Self-organizing maps, Deep Belief Nets, Expectation Maximization (EM), Gaussian Mixture Models (GMM) and Evaluation metrics for clustering problems
Probabilistic graphical models Bayesian Network, Markov Networks, Variational inference, Markov chain, Monte Carlo methods, Latent Dirichlet Allocation (LDA), Inference methods such as Belief Propagation, Gibbs Sampling
Dimensionality reduction Auto encoders, t-SNE, Principal Component Analysis (PCA), Singular Value Decomposition (SVD), Spectral Clustering and Matrix Factorization
Sequential models Hidden Markov model (HMM), Conditional random fields (CRF), Recurrent Neural Network (RNN), Natural Language processing applications such as Named Entity Recognition (NER) and Parts of Speech (POS) tagging Reinforcement Learning State–action–reward–state–action (SARSA), explore-exploit techniques, multi-armed bandits epsilon greed UCB, Thompson Sampling Q-learning, and Deep Q-Networks (DQNs). Applied to domains such as retail, Speech, NLP, Vision, robotics etc.
Deep Neural Networks / Deep Learning Feed forward Neural Networks Convolutional Neural Networks Backpropagation Recurrent Neural Networks (RNNs) Long Short Term Memory (LSTM) networks GAN Attention Dropout Vanishing gradient Activation Functions
Natural Language Processing Statistical Language Modelling Latent Dirichlet allocation (LDA) Named Entity Recognition (NER) Word Embedding Word2Vec Sentiment Analysis BERT: Bidirectional Encoder Transformer. ULMFiT
Image and Computer Vision Object Detection Image recognition Pattern recognition FaceNet CNN YOLO