My biggest beef involves privacy. You can't limit who sees your synth. All synths are public. As with YouTube or Flickr, folks can leave comments. Privacy controls are in the works.
Microsoft acknowledges there's work to be done; the company isn't sure whether to call Photosynth a "beta" or 1.0 release. Still, even with its limitations, Photosynth is worth a visit.