Get the Disable Horse Holstering mod and set the HORSE_HOLSTERING option in the config to 0. that completely disables the storing and retrieving of guns from the horse.
Nice mod. One mod incompatibility I found is the Selling guns mod. Nothing too terrible but guns sold to those dealers is at a fraction of their original price, and then the money is correctly taxed by this mod, but that still amounts to more money than what you spent buying the gun. Allowing a very easy infinite money loop of buying a gun at the gunsmith, and selling it for like triple the price. I don't know if you can like, just quadruple the tax when at those locations or something but either way, it's not the end of the world - I just won't use the gun buyer as an infinite money source.
Works great. I love the concept BUT it would be nice to be able to configure what categories of things get deleted, like maybe yes to valuables but not provisions or money, and so on. Or maybe at least an alternate version that doesn't take your guns. Or-or, specifically the bow. It is very difficult to get a new bow if you lose yours, and it would be a nice consolation weapon if all your other ones are deleted. I do like though that the guns on your horse don't get deleted, that does add a certain level of risk-vs-reward of carrying your prized swiss-cheese-maker into battle (but I'd still rather just keep all my guns if given the option). Also the banking mod works perfectly in conjunction with this: keep money in the bank and you don't lose it on death.