Hide add to cart based on cart items

I need to be able to hide the add to cart button of certain products are already in the cart.

I have Full Page Cache turned on so it seems to cant access the checkout session.

What would be the best approach to take on this?