Thanks for putting the warning in.
I probably wouldn't do it because of the risk of being attacked.
I've heard of several friends of friends that were attacked by taxi drivers though.
Good luck to anyone who would do it. Plus driving a few blocks through the city should be fine, if you can find a driver happy to take you such a short distance