First time visitors will have to get everything from server but then stylesheets .... and other resource files will be cached for 1 month so page refreshes are faster now.
Of course if you choose to clear your cache then it'll have to reload everything again.
But I am happy with the speed improvement now.
