| Title | Deep Embedding Logistic Regression |
| Publication Type | Conference Paper |
| Year of Publication | 2018 |
| Authors | Cui, Zhicheng, Zhang, Muhan, Chen, Yixin |
| Conference Name | 2018 IEEE International Conference on Big Knowledge (ICBK) |
| Keywords | accountability, actionability, classification, classification accuracy, composability, deep embedding logistic regression, deep neural networks, DELR, DNNs, feature extraction, interpretability, Kernel, learning (artificial intelligence), Logistics, LR, Mathematical model, Metrics, narrow neural network, network accountability, neural nets, Neural networks, nonlinear dimension-wise feature embedding, Numerical models, pattern classification, Predictive models, pubcrawl, regression analysis, Resiliency |
| Abstract | Logistic regression (LR) is used in many areas due to its simplicity and interpretability. While at the same time, those two properties limit its classification accuracy. Deep neural networks (DNNs), instead, achieve state-of-the-art performance in many domains. However, the nonlinearity and complexity of DNNs make it less interpretable. To balance interpretability and classification performance, we propose a novel nonlinear model, Deep Embedding Logistic Regression (DELR), which augments LR with a nonlinear dimension-wise feature embedding. In DELR, each feature embedding is learned through a deep and narrow neural network and LR is attached to decide feature importance. A compact and yet powerful model, DELR offers great interpretability: it can tell the importance of each input feature, yield meaningful embedding of categorical features, and extract actionable changes, making it attractive for tasks such as market analysis and clinical prediction. |
| DOI | 10.1109/ICBK.2018.00031 |
| Citation Key | cui_deep_2018 |
Deep Embedding Logistic Regression