I was thinking about if the open source community did something like this with OpenGL and would be able to replace X. It is my understanding the X is software rendered, but most people have a video card that can do some sort of hardware rendering so why not use it?