Bayeux has been in history a number of times, including WWII, but it is perhaps best known for the beautiful tapestry of the same name.
The Bayeux tapestry tells the tale of the events leading up to the battle of hastings of 1066, when the Normans invaded Great Britain. The tapestry "weaves" a tale (sorry, couldn't pass that one up) of the battle as well.
For a great web site that has nice pictures of each, try http://www.sjolander.com/viking/museum/bt/bt.htm