AIXIjs
As part of my Masters work, I created a JavaScript web demo: AIXIjs. Check it out!
Update [2018-07-10]: Along with the excellent Tom Everitt, I presented a tutorial on AIXI at AAMAS 2018, in Stockholm, Sweden. My slides here, complete tutorial website here.