Erjavec said the two countries shared the view that Western Balkan countries should join the EU and NATO as soon as possible and they had similar opinions on the Ukraine crisis.

"We're both very reserved about economic sanctions [against Russia]. We both support political dialogue, in particular between Russia and Ukraine, and have high expectations from the Geneva talks," Erjavec said.

The pair also touched on the South Stream gas pipeline, a project to ship Russian gas to the EU that is widely seen as in danger of collapsing due to Russia's rule in the Ukraine crisis.

Vigenin said Bulgaria supported the project, which is "in the interest of all EU members and the countries through which the pipeline will go".

However, he acknowledged that his country wanted to reduce the reliance on Russian gas and was looking for alternative solutions.

Erjavec described the visit as an introduction of intensification of bilateral relations and said a Bulgarian business delegation would be in Slovenia next month, followed by a visit by the Slovenian prime minister in Bulgaria in autumn.

Vigenin also discussed boosting bilateral cooperation with President Borut Pahor, who received the Bulgarian foreign minister later in the day. The pair pointed to untapped potential in economic cooperation.

What is more, talks at the Presidential Palace also revolved around Ukraine, with Pahor and Vigenin highlighting the importance of EU's united stand on the issue while resuming dialogue with Russia. They also believe Europe should consider long-term relations between the bloc and its eastern partners.