Comic artists put in a lot of effort into directing the viewer’s attention. We collected eyetracking data on a variety of legacy comic book panels, and used this corpus to study viewer gaze behavior, as well as, drive computational algorithms.

Creating Segments and Effects on Comics by Clustering Gaze Data

“Creating Segments and Effects on Comics by Clustering Gaze Data”, Ishwarya Thirunarayanan, Khimya Khetarpal, Sanjeev Koppal, Olivier Le Meur, John Shea and Eakta Jain, ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 2017.

• Paper (preprint) (PDF – 23MB)
• Video (MP4 – 26MB)
• Toolbox (ZIP – 46.2MB)
• Bibtex entry:
  @article{thirunarayanan2017,
  title = {Creating Segments and Effects on Comics by Clustering Gaze Data},
  author = {Thirunarayanan, Ishwarya and Khetarpal, Khimya and Koppal, Sanjeev and Le Meur, Olivier and Shea, John and Jain, Eakta},
  journal = {ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM)},
  pages = {24:1–24:23}
  numpages = {23}
  doi = {10.1145/3078836}
  year = {2017},
  publisher = {ACM},
  }

Predicting Moves-on-Stills for Comic Art using Viewer Gaze Data

“Predicting Moves-on-Stills for Comic Art using Viewer Gaze Data”, Eakta Jain, Yaser Sheikh, Jessica Hodgins, IEEE CG&A Special Issue on Quality Assessment and Perception in Computer Graphics 2016.

• • Paper (preprint) (PDF – 2.4MB)
  • Video (MOV – 52.3MB)
  • Bibtex entry:
    @article{jain:2016,
    author = {Jain, Eakta and Sheikh, Yaser and Hodgins, Jessica},
    title = {Predicting Moves-on-Stills for Comic Art using Viewer Gaze Data},
    journal = {IEEE CG&A Special Issue on Quality Assessment and Perception in Computer Graphics},
    year = {2016},
    pages = {34 – 45},
    numpages = {12},
    doi = {10.1109/MCG.2016.74},
    volume =
    number =
    organization = {IEEE}
    }

We thank MARVEL comics for permission to use comic images.

A Preliminary Benchmark of Four Saliency Algorithms on Comic Art

“A Preliminary Benchmark of Four Saliency Algorithms on Comic Art”, Khimya Khetarpal, Eakta Jain, IEEE International Conference on Multimedia and Expo MMArt Workshop 2016.

• Paper (IEEE Xplore)
• Paper (preprint) (Uncompressed PDF – 16.7MB)
• Paper (preprint) (Compressed PDF – 0.74MB)
• Video
• Presentation slides (PPTX – 29.5MB)
• Bibtex entry:
  @inproceedings{khetarpal2016comicart,
  title = {A Preliminary Benchmark Of Four Saliency Algorithms On Comic Art},
  author = {Khetarpal, Khimya and Jain, Eakta},
  journal = {International Workshop on Multimedia Artworks Analysis (MMArt), IEEE ICME Workshops},
  pages = {1–6},
  numpages = {6},
  doi = {10.1109/ICMEW.2016.7574728},
  year = {2016},
  organization = {IEEE}
  }

Leveraging Gaze Data for Segmentation and Effects on Comics

“Leveraging Gaze Data for Segmentation and Effects on Comics”, Ishwarya Thirunarayanan, Sanjeev Koppal, John Shea, Eakta Jain, ACM Symposium on Applied Perception Poster 2016.

• Poster abstract (PDF – 2.7MB)
• Video (MOV – 2.4MB)
• Poster (PDF – 48.3MB)
• Presentation (PPTX – 5.6MB)
• Download Toolbox (ZIP – 46.2MB)
• Bibtex entry:
  @refereedabstract{abstract,
  author = {Thirunarayanan, Ishwarya and Koppal, Sanjeev and Shea, John and Jain, Eakta},
  title = {Leveraging Gaze Data for Segmentation and Effects on Comics},
  howpublished = {SAP Poster Abstract},
  pages = {137–137},
  numpages = {6},
  doi = {10.1145/2931002.2947703},
  month = {6},
  year = {2016},
  }

DeepComics: saliency estimation for comics

“DeepComics: saliency estimation for comics”, Kevin Bannier, Eakta Jain, Olivier Le Meur, ACM Symposium on Eye Tracking Research & Applications (ETRA) 2018.

• Website
• Bibtex entry:
  @inproceedings{Bannier2018,
  Title = {DeepComics: Saliency estimation for comics},
  Author = {Bannier, Kévin and Jain, Eakta and Le Meur, Olivier},
  booktitle ={ACM Symposium on Eye Tracking Research and Applications},
  numpages = {4},
  year ={2018}
  }

The documents contained in these directories are included by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a non-commercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author’s copyright. These works may not be reposted without the explicit permission of the copyright holder.