Kenya exported its first shipment of crude oil on Sunday, joining Uganda as the only two East African nations to export the commodity.