A window sill (also written as windowsill or window-sill) is the surface at the bottom of a window. They are not up top.
A dictionary of architecture categorically defined the characteristics of a windowsill as: