Some oriole feeders also offer sugar water and grape jelly. Learn more about how to feed orioles. Don’t stop at oranges. Birds who enjoy a sweet orange treat will often eat other ripe fruit ...