fred-brooksFred Brooks was in the process of looking for his next research agenda when he heard Ivan Sutherland give a speech in 1965 at a computer conference that laid out his vision for future of virtual reality. Sutherland said that you shouldn’t think of a computer screen as a way to display information, but rather as a window into a virtual world that could eventually look real, sound real, move real, interact real, and feel real.

Brooks won the Turing Award in 1999 for some of his pioneering work in the computer architecture, operating systems, and software engineering when he was at IBM. He also wrote the famous book, The Mythical Man-Month based upon some of his experiences. In 1964, Brooks left IBM to start the computer science department at the University of North Carolina at Chapel Hill.

Sutherland’s vision was articulated fully in his 1965 “The Ultimate Display” paper that predicts the trajectory of technology towards virtual reality, head-mounted displays, eye tracking, haptics, speech recognition, and even the holodeck.

I had a chance to catch up with Brooks at the IEEE VR conference in South Carolina in March where he shared some of the highlights from the very beginning of VR, and then on through the big milestones that he’s seen develop over the last fifty years.

LISTEN TO THE VOICES OF VR PODCAST

Fred Brooks recalled seeing Sutherland speak at the Fall Joint Computer Conference in 1965, but I could not find any mention of Sutherland’s speech from the publication of the conference proceedings listed online. I did find that Sutherland’s “The Ultimate Display” paper was published in 1965 in the Proceedings of the IFIP Congress, pp. 506-508.

Brooks had a paper titled “The Future of Computer Architecture” that was also published in that same Proceedings of the IFIP Congress in 1965, and so it’s possible that Sutherland’s speech happened at the International Federation for Information Processing conference rather than the Fall Joint Computer Conference. Whenever this speech happened may well be the first time that Sutherland shared his thoughts about what would become virtual reality to a public gathering of his academic peers.

By 1968, Sutherland had built a prototype of the Sword of Damocles, and published a paper titled “A Head-Mounted, Three-Dimensional Display” within the AFIPS Proceedings of the Fall Joint Computer Conference, Part I, pp. 757-764. Last year at IEEE VR, I interviewed Henry Fuchs who was one of Sutherland’s students and fellow VR professor at UNC Chapel Hill.

The virtual reality research that has happened at the University of North Carolina at Chapel Hill has laid the foundations for the current VR revolution, and Brooks wants the current VR enthusiasts to remember that Sutherland had laid it all out from the very beginning in 1965 with that speech of his vision of making computer graphics that look real, sound real, move real, interact real, and feel real.

Subscribe on iTunes

Donate to the Voices of VR Podcast Patreon

Music: Fatality & Summer Trip

Newsletter graphic

This article may contain affiliate links. If you click an affiliate link and buy a product we may receive a small commission which helps support the publication. More information.


  • Kai2591

    VR prophet.

    But what the hell is a ‘Sword of Damocles’???

    • Frikster42

      The name of the first VR-AR headset ever made.
      https://en.wikipedia.org/wiki/The_Sword_of_Damocles_(virtual_reality)

      In the original Greek story (source: Wiki), Damocles was pandering to Dionysius, his king, and exclaimed to him that he was truly fortunate as a great man of power and authority, surrounded by magnificence. Dionysius then offered to switch places with Damocles so that Damocles could taste that very fortune firsthand. Damocles quickly and eagerly accepted the king’s proposal. Damocles sat down in the king’s throne surrounded by every luxury, but Dionysius arranged that a huge sword should hang above the throne, held at the pommel only by a single hair of a horse’s tail. Damocles finally begged the king that he be allowed to depart because he no longer wanted to be so fortunate, realizing that with great fortune and power comes also great responsibility and danger.

      The VR headset is named after the sword in this story because of how powerful it might make you feel being at the precipice of technological achievement, at the forefront of new potentially powerful discoveries to be made that could also be very dangerous. The headset provides the user with imminent and ever-present peril by placed him/her in a position of power. Also the headset was also just ridiculously big and unwieldly as fuck providing the user neck pains as well, so I guess it needed a bad-ass name that makes you think of an unwieldly and ridiculously big anime sword.

      • Kai2591

        Ohhh thanks!
        Damn that is so symbolic poetic af

  • Jacki Morie

    Great interview with a real VR gem!

  • Jacki Morie

    Last paragraph of Sutherland’s paper: we need some hearts and mind on the future “nano-molecular display” that renders solid matter out of nano particles IN REAL TIME.

  • Sean