It definitely needs to be inside the
<?php ?> code block, or it’s just HTML to the browser. You probably didn’t have it in a code block if you saw it displayed.
A syntax highlighting editor helps a lot with this. It helps you see what is code and what is plain text.