Don't know what class you are, but if you have a long cc (icy grave, hypno, lullaby, lethargy potion, debilitating plague), use it on Merry and kill his monkey. If you don't manage to kill him before he starts summoning the monkey again, make sure you re-cast your long cc, this will interrupt monkey summon.