Preheat the broiler. Arrange plum halves on a broiler pan, cut side up. Place vanilla bean seeds into a small bowl; add the orange zest and sugar. Rub together with your fingertips to blend, then sprinkle over the plums. Broil until browned in spots, about 10 minutes. Serve the plums with vanilla ice cream.