Capsule based image translation network

Fei Yang, Zheng Lu, Guoping Qiu, Qian Zhang

Research output: Chapter in Book/Conference proceedingConference contributionpeer-review

1 Citation (Scopus)

Abstract

Along with the development of deep learning, the research of computer vision has attracted much attention in recent years. Among various research topics, image translation is quite a hot one, which aims to translate an image into another domain according to the exact application purpose. In this paper, we present a novel capsule based conditional generative adversarial network that can automatically synthesize the image with realistic and aesthetically pleasing effect from a given image. By designing the capsule blocks in both the generator and discriminator and a novel multi-way optimization function, our framework can generate more realistic images than other frameworks. For the specific application, effect rendering, an effective line preservation loss is well designed and helps the framework to focus the synthesis of the texture around the lines, which not only improves the local line visual effect, but also enhance the global lighting effect around the lines. The experiments show that our improvement is effective and provides significant help to the overall framework. Our framework is tested on the effect rendering dataset and we compare our approach with multiple state-of-the-art methods. We achieved the best results.

Original languageEnglish
Title of host publicationIET Doctoral Forum on Biomedical Engineering, Healthcare, Robotics and Artificial Intelligence 2018, BRAIN 2018
PublisherInstitution of Engineering and Technology
EditionCP754
ISBN (Print)9781785617911, 9781839530838
DOIs
Publication statusPublished - 2018
EventIET Doctoral Forum on Biomedical Engineering, Healthcare, Robotics and Artificial Intelligence 2018, BRAIN 2018 - Ningbo, China
Duration: 4 Nov 2018 → …

Publication series

NameIET Conference Publications
NumberCP754
Volume2018

Conference

ConferenceIET Doctoral Forum on Biomedical Engineering, Healthcare, Robotics and Artificial Intelligence 2018, BRAIN 2018
Country/TerritoryChina
CityNingbo
Period4/11/18 → …

Keywords

  • Artificial Intelligence
  • Capsule Net
  • Deep Learning
  • Generative Adversarial Net
  • Image Translation

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Capsule based image translation network'. Together they form a unique fingerprint.

Cite this