The picture is of a plaque to the first recorded game in Canada in 1833. The plaque is in Beachville, Ontario.
You can read more on the history of baseball in Wikipedia.
My recollection from school is that boys played cricket, and girls played rounders. Rounders being a game very similar to baseball.