The chalkboard gag is a reference to the fact that the Treehouse of Horror episodes usually air sometime in early November.
Mr. Burns says "What the deuce?" in a similar fashion to Stewie Griffin from Family Guy.
Agnes Skinner mentions giving birth to Seymour Skinner by saying "I carried you in my belly for 4 and a half months. When you fell under the bus that is when my job ended". However, in "The Principal and The Pauper", this Seymour Skinner is revealed to actually be Armin Tamzarian and has no relation to Agnes. However, the backlash on this episode was rumoured to make this episode redundant and no longer canon. Indeed, Matt Groening and and Harry Shearer have gone on record to say that this was their least favourite episode.
Bender from Futurama appears on the cover of an issue of Popular Robotics, a robotics-themed magazine seen on Bart's desk.
The song is titled Embraceable You.