Currently there is not a filter by character in the front end, only in the admin. This feature will be migrated to the front end sometime soon, no exact ETA at the moment.
What is available is the show_alphaindex shortcode option. However, this does not filter by character. It jumps to that character group if it is on the current page of results.