It is better to have all the metal coated with 2 coats of unreduced epoxy, then use fillers over the epoxy after it has cured. This will give you an unbroken seal over the panel for best adhesion and corrosion protection. I put fillers directly on the metal for years with very few issues, but did find a few times when I had to do a repair years later that rust would be under my filler. I haven't had that since doing the epoxy first.