How to display only the most relevant filters?

Algolia does that out of the box. If you are using facets, Algolia will automatically send you the most relevant (frequent) values for each facet, depending on the current search.

If you're implementing an instant search results page, the filters will be updated at each keystroke.