Tag: lovecraft

  • The Lovecraft Test, Gemini 2.5-pro

    The Lovecraft Test, Gemini 2.5-pro

    At the same time as I was fighting with GPT-5 to give me the thing I actually wanted, I also used the Gemini app and the access I have to pro-level Gemini models to do the Lovecraft test with 2.5-pro. Previously, I had only tested with Flash-2.0, so, not only should this be a more…

  • The Lovecraft Test, GPT-5

    The Lovecraft Test, GPT-5

    GPT-5 is out now and I’ve only had a couple occasions to interact with it directly. So, I thought it was time to run it through the Lovecraft test. ChatGPT has adopted this quirk of late where, when it’s done answering your question or responding to your prompt, it says something to the effect of…

  • The Lovecraft Test, Gemini

    The Lovecraft Test, Gemini

    I’ve been sitting on this one for longer than I should have (and then, obviously, forgetting entirely about it). After putting DeepSeek through the ropes for my Lovecraft test, I decided to try Google’s Gemini. I haven’t used Gemini much, although I have used NotebookLLM which is based on Gemini, and I think it generally…

  • The Lovecraft Test, DeepSeek Edition

    The Lovecraft Test, DeepSeek Edition

    The stupidly big news in LLMs right now is that DeepSeek, a LLM built by a small Chinese team that was released a couple weeks ago, performs as well as, if not better than larger, more sophisticated (at least in terms of the dollars and hardware thrown at it) models by OpenAI and Anthropic (Claude)…

  • The H.P. Lovecraft Test, round 3

    The H.P. Lovecraft Test, round 3

    I’ve run this test twice already and I figured it was probably about time to try it again. If you’ve been reading my AI posts (which is all I post anymore), you may remember past incarnations of what I like to call The Lovecraft Test. I ran it very early on with ChatGPT when it…