Buying TVA inclusive from European wholesalers

I am a designer/maker and as such I need certain supplies which I cannot always get from France. The supplier in this situation is in the Netherlands. They are the manufacturer of these supplies, they are large and reputable. I knew them from a small business I had in Greece but back then I bought via their Greek supplier. Since they are not well represented in France they agreed to sell directly.

I asked for a quote on some supplies and subsequently I paid for the goods and they delivered them, great! However, I never supplied a VAT / TVA number as we are not TVA registered. After delivery, and without contacting me first, they sent me an invoice with the total amount excluding tax and a note on it Exemption tax: Delivery of goods within EC. I am now in possession of goods on which no TVA has been paid and I am not TVA exempt.

I contacted them and offered to pay the TVA. They replied via e-mail that they can not sell to me if my business does not have an official TVA number. They did not take my offer and they are not offering a solution either. Is there anything preventing an auto-entrepreneur business from buying from an EU country other than France? What should I do? I do not want to pay a fine. Can I pay the TVA in France or must the supplier collect it for the Netherlands?