Many people in this world are able to conceive that ghosts exist, that a god created the world in seven days, the world is flat, there was no moon landing in 1969, the Earth was created between about 10,000 and 6,000 years ago, men can be women, that photographs steal souls, that particles can emerge from a quantum vacuum and that planting should follow the phases of the moon.
It should not be too difficult to conceive of a world where adding one to four results in three.
It is certainly the case that the physics of a possible world where adding one rock to four rocks results in three rocks is breath-taking, and incoherent within our world, but not incoherent within a world where this happens to obtain.
Philosophy should look to science.
You find it incoherent that something may cease to exist, yet in this world it is commonly accepted in quantum mechanics that not only may something exist in more than one place at one time but also that something may appear from nowhere.
For example, within contemporary science is the Mathematical Universe Hypothesis (MUH) where different worlds possess different mathematical structures (Wikipedia - mathematical universe hypothesis)
Max Tegmark proposed that our physical reality is not just described by maths, but is maths itself. In this view, such a mathematical structure of physical reality would be independent of human thought. Every consistent mathematical structure would then correspond to a unique, physical world in a parallel universe. If 4 + (-1) is a consistent mathematical structure, then it is possible that in a parallel world, the addition of something to four would result in three.
It is a truism that the physical laws we know are those laws we know about. We know adding one to four results in five because this is what we have observed, but may be explained anthropically, in that if it was otherwise, there would be no one around to know.
The physics of the MUH may be breath-taking, but would be a mistake to say incoherent.