Today I rendered 1300 dynamic, movable, multicolored lights with the same amount of torch-geometry and even more walls with a decent framerate. Wohoo!!
At first I had performace problems but then I removed one main optimization step and the whole thing speeded up immensely! Strange isn't it!?
PS: You can't see the torches on the picture because they are underneath the surface.