Using this plugin you can set an Alphabetic Bar in the top or any List of Products.

By default, TheCartPress Loops have this template tag, but if you are using any other template to display your list of products, you have to add this template tag:

<?php tcp_the_az_panel(); ?>

Take a look to a this example