I need access to VAT Stamp Home Page, Only First Home Exception is showing for me.

Please follow the below link:

https://public.gov.bs/sites/PUB_VATstamp/Pages/home.aspx

This can also be accessed from public.gov.bs. On the left hand side of the screen you will see a panel called Other Sites. All the government portals are accessible from this panel.