Here are two examples of buildings designed for specific Olympic events. It appears for sustainability sake, reuse is gaining popularity over iconic structures. Read more.
Yoyogi National Stadium by Kenzo Tange (1964)
Handball, badminton and wheelchair rugby
Tokyo Metropolitan Gymnasium by Fumihiko Maki (1991)
Table tennis