The CAVE would be an ideal environment to view VRML worlds. As described in the VRML 1.0 Specification

The Virtual Reality Modeling Language (VRML) is a language for describing multi-participant interactive simulations—virtual worlds networked via the global Internet and hyperlinked with the World Wide Web. All aspects of virtual world display, interaction and internetworking can be specified using VRML. It is the intention of its designers that VRML become the standard language for interactive simulation within the World Wide Web.

Use SDSC WebView as a base for the http stuff and the pfCAVE library for the graphics stuff.