If you use Chrome or Opera, use the developer tools, and under the "Network" tab, you can see the loading times for the assets. You can see from there where the slow load time is (the waterfall chart too). There you should be able to see if it is Google maps or something else. You can also analyze the Javascript there to see what the slow loading times are.