9 times out of 10 you won't have to worry about it. (Actually, your odds are far better than that, even.) But some people are aware of copyright laws and will use them against you if you've used their copyrighted work without permission. The best policy is to assume that nothing is in the public domain unless the web site specifically states that is.
And anyway, it's polite to ask for permission. Whatever happened to common courtesy?