That was fun, I tried for ten minutes, then let it go. But the thing haunted me over lunch, and without seeing any more dices, by only remembering the rules, I found it. I just tested it and I'm correct

I think it might even be easier if you don't see the dices!