Actually creating pages does get a bit more involved, and should include everything you said, of course. I didn’t get into CSS (cascading style sheets, for those learning the lingo) or a lot of specifics because, well, we were limited on time and wanted to get to so much more. But anyone serious about learning HTML and how it all works should check out the links Patrick included.

A few points:

You should never use HTML to alter the “appearance” of content. That’s the job of your CSS. Tags such as “strong” and “em” should be used for their meaning only.
Many usability studies condemn the use of the target attribute to open new windows with links. That attribute is also deprecated in strict DOCTYPEs.
Every Web page needs a DOCTYPE. Though a bit complex, this AListApart article covers it well.
You should always validate every Web page using the free tool from the W3C. This will take the pain out of bug-checking long lists of HTML.

A great source for both HTML and CSS is the Web site HTML Dog.