The ISEE/PSTEP international workshop on “Benchmarks for Operational Solar Flare Forecasts” was held at ISEE, Nagoya University from 31 October to 2 November 2017. In the workshop, a total of 20 international researchers (including 3 remote attendees) presented their operational flare prediction models and discussed how well today's operational flare prediction models perform based on standard, agreed-upon, comprehensive evaluation methods. We expect that the evaluation infrastructure developed during ​the workshop can be used for validation of future flare prediction models.