"It's the Union, Jack!"
The reason patents will not be affected very much by Brexit is that the European Patent Office is not an EU institution. It refers to geographical Europe. In contrast, the European Union Intellectual Property Office (which handles trade marks and designs) is official an agency of the European Union. It refers to political Europe.