Cremorne Gardens was the name of two pleasure gardens established in England and Australia in the mid 19th century by James Ellis .