@ James
Sounds like you are running a either page cache plugin or server side cache. Try clearing the cache.
Let me know if that helps.