This was a code issue/bug. Did you try the latest, 12.1.4.1? You're on 12.1.4.
This should've been fixed in 12.1.4.1, see here:
File transfer speeds between servers were reduced when SEP NTP is installed
Fix ID: 3198871
Symptom: With the Symantec Endpoint Protection firewall enabled, file transfer performance slows.
Solution: Implemented a kernel traffic cache in the Teefer driver to improve performance.
New fixes and features in Symantec Endpoint Protection and Network Access Control 12.1.4.1 and 12.1.4.1a
http://www.symantec.com/docs/TECH216262