Unlocking True AI Capabilities: Moving Beyond the Limits of LLMs by Understanding Their Inner Workings