There's a difference between not legally recognised and illegal.

Doing this is not illegal, though it may not be recognised as a marriage legally.