Define the font family and call specific glyphs using the \XeTeXglyph command followed by the glyph number.