Yes, you are right about the oceanic magnetization. New oceanic crust is formed along the Mid-Ocean-Ridges and spreads away from the ridge axis. When the basaltic material cools to below about 500 Centigrade, the magnetic minerals "freeze-in" the direction of the Earth's magnetic field. Since the magnetic field reverses every couple of 100,000 years, one finds striped magnetization patterns parallel to the Mid-Ocean Ridges with alternating polarity.
Over the continents it is quite a different story. Here the dominant factors for magnetic anomalies are crustal composition and the thickness of the magnetized layer. Usually, young crust is relatively thin and has low content in magnetic minerals (e.g. western Europe). The old cratons, on the other hand, are thick and have high magnetic mineral content. A prominent anomaly can be seen, for example, at the boarder between young western Europe and the old Baltic Shield. Temperature also plays a role: When the crust is very hot locally and the temperature is higher than the Curie Temperature of the magnetic minerals, the crust is demagnetized, creating a contrast with the surrounding magnetized crust.
Magnetic anomalies are also caused by the contrast between oceanic and continental crust. Furthermore, subduction zones show up as strong anomalies. See for example the Summatra Trench which was the source of the large Indonesian Tsunami. Whether the subduction-zone related anomalies are just due to the "doubling" of the crustal thickness, or due to the specific mineralogy is still not well understood.
Stefan