Try to keep your comps within the last 3 months; oftentimes trulia and zillow are not recent and can be deceiving. You can only get an idea, but at that they are not what you want to rely on for comps.
There is a site in many major cities across the US called redfin. (unfortunately its not everywhere). I love redfin, and it has 10 comps at the bottom, but even better than that, you can pull up a map and go directly to handpick your comps.
1. Try to stay in the same neighborhood like many have said here, but if there isn't enough comps, stay within a mile if possible.
2. Try to only go back 3 months; if there aren't enough try 6
3. Stay within 1 bed and 1 bath, and try to stay the same if possible
4. Stay within 500 square feet; the close in size the better
5. I like to use 10 comps, but try to use at least 5 (the more the better). I like to be conservative because usually the appraisers are.
6. Do not use listings; use sold comps
7. Calculate the cost per square feet for each .
8. Remove the highest and lowest PER SQUARE FEET values
9. Take the remaining prices per square feet and find the average.
10. Multiply that number by the square footage of the property you are comping.
If I'm doing a rehab on the property requiring more than $25K, I usually subtract $10K from the ARV only because our market in my area is still declining slightly, and that will usually take 3 months. You can talk to a realtor in your area to find out the market trends for your city; or you can look in the paper in the real estate section; there is usually a section that talks about the trends.