100% FRESH build, win7 pro 64-bit, NVidia drivers downloaded directly from their site (NOT via Windows update/automatic install).
 
Bios: V2.02 & 8/29/2016 Chipset driver (most recent)
CPU: i7-6950X @ 4.2Ghz
Mobo: EVGA x99 FTW K
GPU: EVGA GTX 1080 FTW
Ram: GSkill F4-3200C14Q-GTZ
PSU: EVGA 1200P2
Case: EVGA DG-87
Cooler: Swiftech H320 X2 Prestige
 
Temps are fine, CPU is less than 45C while gaming, GPU temps remain below 68C while gaming with the core clock being in the 2000Mhz range.
The game runs smooth for about 5-10 minutes before I start getting insane packet loss & stuttering.
1.) https://puu.sh/rvzAy/1cb782f66f.png
2.) https://puu.sh/rvzCk/c8e4764086.png
3.) https://puu.sh/rvzJB/185278990b.png
The yellow spikes are the packet loss, the graph given by BF4's internal network graphing.
 
I've tried repairing the game, the game is a FRESH install on a secondary HDD (had it this way for previous build and it worked fine with NO packet loss or issues). I'm using the Intel NIC on this motherboard and it's updated to the most recent drivers. I've tried turning "Optimize Network" "on" and "off" within BF4 itself with no luck. At first I thought it was just one server but the issue carries over to other ones too, ruling that out.
 
3dmark11 score: http://www.3dmark.com/3dm11/11623739
Cinebench: (top 3 are me, scores differ due to having background programs open when doing the test) https://puu.sh/rvAMg/522312b9b2.png
^Obviously no performance issues there.
 
Don't really know what else to do considering this issue never happened before to me. Every driver is current, FPS is 110+ on ultra at 1440p before this happens, temps are extremely low, yet I get stuttering which causes FPS to dip between 40-70, GPU usage spikes and has a sharp decrease (99% to 30% to 50%, etc. etc.)
 
Thanks for help in advance!
Note: IT'S ONLY WITH BATTLEFIELD 4.
 
 
UPDATE:
1.) Issue happens after a few minutes both in Multiplayer & Singleplayer.
2.) Rolling back Nvidia drivers did not solve the issue.
3.) Updated Router firmware & made sure my Intel NIC was up to date. No change.
4.) G-sync enabled/disabled. No change.
5.) CPU OC/base clocks. No change.
6.) GPU OC/base clocks. No change.
7.) Repaired the game. No change.
8.) Temperatures are well within reasonable limits.
 
I'm at a loss here for what to do.

Haven't tried yet but the stuttering is directly related to the packet loss spikes.

I have a picture of the GPU usage. I'm thinking it may be due to the drivers...
https://puu.sh/rxxHh/a87dfcbb65.png
 
It plays fine for a bit then the usage drops and the stuttering occurs. Don't really know what else it could be. I ruled out the packet loss by playing with the chart open and it was smooth even during spikes. The VRAM of the card isn't an issue as this game only uses about 2.5GB on ultra out of the 8GB total.

Which NIC are you using and have you tried using the other one?  I'm assuming you're using the Killer.  I would download the latest Intel PRO NIC drivers from Intel's web page and try that.

UPDATE:
1.) Issue happens after a few minutes both in Multiplayer & Singleplayer.
2.) Rolling back Nvidia drivers did not solve the issue.
3.) Updated Router firmware & made sure my Intel NIC was up to date. No change.
4.) G-sync enabled/disabled. No change.
5.) CPU OC/base clocks. No change.
6.) GPU OC/base clocks. No change.
7.) Repaired the game. No change.
8.) Temperatures are well within reasonable limits.
 
I'm at a loss here for what to do.