Sumerian, spoken in ancient Mesopotamia (modern-day Iraq), is considered the world's oldest written language, with records going back over 5,000 years. The Sumerians invented a writing system called cuneiform, which pressed wedge-shaped marks into clay tablets.