Open Data in the Age of Generative AI

In recent decades nations around the world have begun to open up significant amounts of the non-personal data they generate, gather and hold. From education to housing, health to transport, urban planning to environmental monitoring, open data has been used to deliver and improve public services. However, significant challenges remain, not least how to make the data accessible and useable across a broad range of contexts. Recent developments in AI may help solve these challenges. Large Language Models (LLMS) such as ChatGPT and Bard, that are themselves trained on very large amounts of data, are adept at question answering, summarisation, and many other tasks. A first stage of work will evaluate the extent to which LLMs as currently implemented are able to access, analyse and repurpose open data resources. A second stage will look to adapt and refine these models through RHLF (Reinforcement Learning through Human Feedback ) to determine if this provides powerful new interfaces to open data resources. Throughout the research fellowship the open data initiatives within the Western Cape, and urban renewal projects such as the Adam Tas Corridor will be some of use cases considered.