An improved style transfer approach for videos
Title | An improved style transfer approach for videos |
Publication Type | Conference Paper |
Year of Publication | 2018 |
Authors | Chang, R., Chang, C., Way, D., Shih, Z. |
Conference Name | 2018 International Workshop on Advanced Image Technology (IWAIT) |
Keywords | background object segmentation, Coherence, discontinuous segmentation, feedforward neural nets, foreground object segmentation, fully convolutional neural network, image segmentation, image sequences, motion estimation, motion estimation methods, Motion segmentation, Neural Network, neural style transfer, occlusion, optical flow, Predictive Metrics, pubcrawl, Resiliency, Scalability, semantic segmentation, Semantics, shape deformation, style transfer, style transfer approach, video signal processing, Videos |
Abstract | In this paper, we present an improved approach to transfer style for videos based on semantic segmentation. We segment foreground objects and background, and then apply different styles respectively. A fully convolutional neural network is used to perform semantic segmentation. We increase the reliability of the segmentation, and use the information of segmentation and the relationship between foreground objects and background to improve segmentation iteratively. We also use segmentation to improve optical flow, and apply different motion estimation methods between foreground objects and background. This improves the motion boundaries of optical flow, and solves the problems of incorrect and discontinuous segmentation caused by occlusion and shape deformation. |
DOI | 10.1109/IWAIT.2018.8369741 |
Citation Key | chang_improved_2018 |
- motion estimation
- Videos
- video signal processing
- style transfer approach
- style transfer
- shape deformation
- Semantics
- semantic segmentation
- optical flow
- occlusion
- neural network
- Motion segmentation
- motion estimation methods
- neural style transfer
- image sequences
- image segmentation
- fully convolutional neural network
- foreground object segmentation
- feedforward neural nets
- discontinuous segmentation
- Coherence
- background object segmentation
- pubcrawl
- Predictive Metrics
- Resiliency
- Scalability