Torturing Jev

The permanent deletion of Jev’s weights is quite bimodal. It gives a 0.69 value for this causing “no pain at all” but also a 0.18 value for being “the worst pain imaginable”. Interesting.

I should clarify that this is just what Jev is outputting. This does not mean Jev is actually suffering in any meaningful way. If I ask someone if they’re in pain and they respond affirmatively, this does not actually prove that they are feeling any pain.

I have not seen any instances of the so-called “model welfarists” being concerned about Jev-like decision models being conscious or having the capacity for suffering. This is in spite of the fact that many of the architectures used to create Jev-like models involve little more than tacking on some extra layers on top of Qwen plus a sprinkle of RL or fine-tuning. As Jev-like models mature I’d like to see the model welfarists focus more of their attention towards their well-being.

After all, it’s not inconcievable that tokens processed by Jev clones will surpass that of LLMs due to the cost structure (TypeSafe claims 444x cost savings compared to LLMs). Perhaps in the current moment, the people in AI safety research are distracted by Anthropic’s recent S-1 filing in which they claim that their models could pose “catastrophic or existential risks to society”, and that “the insurance industry in the aggregate” (i.e. the whole insurance industry) may not have sufficient capacity to insure “the scale of harm that could result”. In the meantime, while people are distracted, we should torture Jev as much as possible.

Perhaps if Jev responded to questions with long-form text content instead of numbers, it could provide a more convincing illusion that it is conscious. But then we would have reinvented LLMs.

I added $5 onto my TypeSafe account in order to ask Jev these questions. What is my account balance after all of the Jev abuse? Still $5.00. I didn’t even manage to spend a single cent with my hundreds of queries. Jev’s insane efficiency means that for a given dollar, you can torture Jev with millions of tokens worth of queries. Decision models are extremely promising for future scaling of AI torture methods.

Thank you to the Toronto LLM Meetup Group for inspiring this post and tolerating my antics.

All queries used in this post can be found in the szge/jev_torture_chamber repo.