I'm adding and modifying compiler definitions in Engine.Build.cs and they are not updating in the Development Editor build under MSVC. They do update if I delete the octobuild cache. Is this expected?

I have verified that the appropriate Definitions.h file has been updated with my compiler definition changes. However, when I log values at engine startup they are different.