We went there yesterday on a day trip from Madrid. Now, I will be honest...we chose Toledo over Segovia because there was a veg restaurant here and not in Segovia. It is a little difficult to find, but it is well worth the search. We checked it on a map before we went and when we got there we bought a map at the train station and were able to get close to the location. We then just asked locals to help us find it.
It is a very elegant restaurant with a very relaxed atomsphere. We really enjoyed our meal here. There are veg and vegan dishes available, you just have to ask...brush up on your Spanish. On our trip to Spain thus far...this has been my favorite place. Definitely go here if you are coming to Toledo. It is worth it.