{"id":163697,"date":"2023-12-27T07:59:04","date_gmt":"2023-12-27T14:59:04","guid":{"rendered":"https:\/\/www.biggerpockets.com\/blog\/?p=163697"},"modified":"2024-02-29T17:26:09","modified_gmt":"2024-03-01T00:26:09","slug":"how-i-use-data-analytics-in-real-estate-investing","status":"publish","type":"post","link":"https:\/\/www.biggerpockets.com\/blog\/how-i-use-data-analytics-in-real-estate-investing","title":{"rendered":"How I Use Data Analytics in Real Estate Investing\u2014Or How I Failed My Way to Success"},"content":{"rendered":"\n\n      <iframe loading=\"lazy\" frameborder=\"0\" height=\"200\" scrolling=\"no\" src=\"https:\/\/playlist.megaphone.fm\/?e=BIGPOC5422666749\" width=\"100%\"><\/iframe>\r\n  \n\n\n\n\n<p>In 2004, I was living in NYC when I decided to start a new career. To identify potential business opportunities, I thought about some of the more frustrating experiences I&#8217;d had. I quickly narrowed the list to buying investment properties.<\/p>\n\n\n\n<p>The problem was that all real estate agents could do was send me MLS data sheets for the properties I selected; no analytics, processes, or services. I had to do everything myself. This was time-consuming, and I made frustrating mistakes that cost me time and money to correct later.&nbsp;<\/p>\n\n\n\n<p>So, there was a business opportunity. Now, I need to know where to create this business (not New York or New Jersey).<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">How I Did My Analysis<\/h2>\n\n\n\n<p>I started researching <a href=\"https:\/\/www.biggerpockets.com\/blog\/the-chick-fil-a-method-and-how-to-use-corporate-market-research-in-real-estate\" target=\"_blank\" rel=\"noreferrer noopener\">how retail store chains select locations for new stores<\/a>. Based on my research, I determined the sequence of events necessary for success, as shown in the chart.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"626\" height=\"234\" src=\"https:\/\/www.biggerpockets.com\/blog\/wp-content\/uploads\/2023\/12\/image1.jpg\" alt=\"deal analysis\" class=\"wp-image-163700\" title=\"\" srcset=\"https:\/\/www.biggerpockets.com\/blog\/wp-content\/uploads\/2023\/12\/image1.jpg 626w, https:\/\/www.biggerpockets.com\/blog\/wp-content\/uploads\/2023\/12\/image1-300x112.jpg 300w\" sizes=\"auto, (max-width: 626px) 100vw, 626px\" \/><\/figure>\n<\/div>\n\n\n<p>My first decision was <a href=\"https:\/\/www.biggerpockets.com\/blog\/breaking-down-the-location-location-location-principle-in-real-estate\" target=\"_blank\" rel=\"noreferrer noopener\">location<\/a>. Based on my research, I selected Las Vegas.<\/p>\n\n\n\n<p>The next step was to determine the right tenant pool segment to target. This step is crucial because the only way to have a reliable income is if reliable tenants continuously occupy the property. A reliable tenant stays for many years, always pays the rent on schedule, and takes good care of the property.<\/p>\n\n\n\n<p>Based on my experience with rental properties and what I learned from others, reliable tenants are the exception, not the norm. Because my clients and I plan to hold these properties for many years, we will need multiple reliable tenants throughout the hold time. The best way to increase the chances of always having a reliable tenant is to purchase properties that attract people from a segment with a high concentration of reliable people.<\/p>\n\n\n\n<p>Therefore, my task was to find a tenant segment with a high concentration of reliable tenants.<\/p>\n\n\n\n<p>As an engineer, I used the standard approach of analyzing data. I tried various (paid and free) data sets and wrote a lot of software, but (I would be embarrassed to tell you how long I persisted) I finally decided that classic data analysis would not work. The fundamental problem is that humans do not behave algorithmically. So, I ditched this approach.<\/p>\n\n\n\n<p>Next, I decided to mine historical rental data to understand past tenant behaviors. I downloaded about 10 years of MLS rental history data and started over. I tried many things (that failed), and then I plotted monthly rent versus length of stay.&nbsp;<\/p>\n\n\n\n<p>The result was similar to the chart, showing a strong correlation between how long a tenant stays in the property and the amount of rent. This was the starting point I had been searching for.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"590\" height=\"240\" src=\"https:\/\/www.biggerpockets.com\/blog\/wp-content\/uploads\/2023\/12\/image2.jpg\" alt=\"rent analysis chart\" class=\"wp-image-163701\" title=\"\" srcset=\"https:\/\/www.biggerpockets.com\/blog\/wp-content\/uploads\/2023\/12\/image2.jpg 590w, https:\/\/www.biggerpockets.com\/blog\/wp-content\/uploads\/2023\/12\/image2-300x122.jpg 300w\" sizes=\"auto, (max-width: 590px) 100vw, 590px\" \/><\/figure>\n<\/div>\n\n\n<p>I investigated the segment of tenants who stayed over five years, converting the low and upper rent range of properties they occupied to approximate gross monthly income using monthly rent\/30% = gross monthly wage.<\/p>\n\n\n\n<p>I next interviewed property managers and cruised job boards to determine probable jobs based on gross monthly income. By doing this, I concluded that people earning below a certain wage tended to have lower-skilled jobs, which made them vulnerable to layoffs during economic downturns. Therefore, I raised the lower-income threshold above this wage.<\/p>\n\n\n\n<p>I next looked at the upper-end income range and determined that jobs above a certain wage were primarily administrative. These workers would also be laid off during economic downturns. So, I lowered the upper-income threshold below this wage level.<\/p>\n\n\n\n<p>The result was a narrow wage\/rent range that I believed to have secure jobs due to the nature of their work, as shown in the chart.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"758\" height=\"326\" src=\"https:\/\/www.biggerpockets.com\/blog\/wp-content\/uploads\/2023\/12\/image3.jpg\" alt=\"target tenant segment\" class=\"wp-image-163698\" title=\"\" srcset=\"https:\/\/www.biggerpockets.com\/blog\/wp-content\/uploads\/2023\/12\/image3.jpg 758w, https:\/\/www.biggerpockets.com\/blog\/wp-content\/uploads\/2023\/12\/image3-300x129.jpg 300w\" sizes=\"auto, (max-width: 758px) 100vw, 758px\" \/><\/figure>\n<\/div>\n\n\n<p>Each tenant segment has specific housing requirements and is unlikely to rent a property if it does not meet all their requirements. So if you buy a property that matches the housing requirements of a specific tenant segment, most of the applicants will be from that segment.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Creating a Property Profile<\/h2>\n\n\n\n<p>To determine the characteristics of properties that would attract my target tenant segment, I used data analytics to determine what and where they rent today. From this, I created what I refer to as a property profile.&nbsp;<\/p>\n\n\n\n<p>A property profile is a physical description of the properties that this segment is currently renting. It has at least four elements:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Location: <\/strong>The locations where significant percentages of the target segment are renting today.<\/li>\n\n\n\n<li><strong>Property type:<\/strong> What type of properties are they renting today? Condo, high-rise, multifamily, single-family?<\/li>\n\n\n\n<li><strong>Rent range:<\/strong> What the segment is willing and able to pay.<\/li>\n\n\n\n<li><strong>Configuration: <\/strong>Two bedrooms, three-car garage, large backyard, single-story, two stories?<\/li>\n<\/ul>\n\n\n\n<p>I ran correlations between properties identified by the property profile and actual historical rental data and found a high correlation between the two. After so long, I thought I had what I needed.<\/p>\n\n\n\n<p>And then reality came crashing down.<\/p>\n\n\n\n<p>The issue was that numerous new listings entered the market daily, and the most desirable properties often went under contract within two to three days. This left us only 24 to 36 hours after a property was listed to identify it as a potential option, evaluate it, gather analytical information, and submit an offer.<\/p>\n\n\n\n<p>Doing this process manually for hundreds of properties each day was impossible. So, once again, I turned to data analytics.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Our Data Mining Engine<\/h2>\n\n\n\n<p>I\u2019ve worked on data mining engines for investment property selection since 2007. All the algorithms I tried were similar to what Rentometer, Zillow, and Opendoor were using, which was not nearly good enough to make purchase decisions.&nbsp;<\/p>\n\n\n\n<p>Finally, around 2015, I discovered a very different methodology to find good properties. I am still enhancing that software to this day.<\/p>\n\n\n\n<p>Our data mining engine architecture is illustrated here.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"519\" height=\"313\" src=\"https:\/\/www.biggerpockets.com\/blog\/wp-content\/uploads\/2023\/12\/image4.jpg\" alt=\"data mining engine\" class=\"wp-image-163699\" title=\"\" srcset=\"https:\/\/www.biggerpockets.com\/blog\/wp-content\/uploads\/2023\/12\/image4.jpg 519w, https:\/\/www.biggerpockets.com\/blog\/wp-content\/uploads\/2023\/12\/image4-300x181.jpg 300w\" sizes=\"auto, (max-width: 519px) 100vw, 519px\" \/><\/figure>\n<\/div>\n\n\n<p>After years of improvements, the engine can now find the small number of potential investment properties from among thousands in less than five minutes.<\/p>\n\n\n\n<p>However, data analytics can only go so far because software only deals with data, and we are dealing with humans.<\/p>\n\n\n\n<p>I next put together a team and processes that took the output of the data mining engine and selected properties that matched individual clients\u2019 requirements. These properties are then rigorously evaluated by a team of experts, as illustrated in the chart.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"798\" height=\"440\" src=\"https:\/\/www.biggerpockets.com\/blog\/wp-content\/uploads\/2023\/12\/image5.jpg\" alt=\"data mining engine 2\" class=\"wp-image-163702\" title=\"\" srcset=\"https:\/\/www.biggerpockets.com\/blog\/wp-content\/uploads\/2023\/12\/image5.jpg 798w, https:\/\/www.biggerpockets.com\/blog\/wp-content\/uploads\/2023\/12\/image5-300x165.jpg 300w, https:\/\/www.biggerpockets.com\/blog\/wp-content\/uploads\/2023\/12\/image5-768x423.jpg 768w\" sizes=\"auto, (max-width: 798px) 100vw, 798px\" \/><\/figure>\n<\/div>\n\n\n<p>Only if a property matches the client\u2019s requirements and passes evaluation by multiple team members do we send the client a property report containing the analytical information they need to make an informed decision. Due to our software, processes, and team members, we can evaluate numerous properties in a single day and present our clients with actionable information on properties that match their individual profiles within that same day.<\/p>\n\n\n\n<p>Our clients feel our data analytics and processes are effective.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Final Thoughts<\/h2>\n\n\n\n<p>Data analytics and processes are the cornerstone of our business. Without data analytics, we could not find the properties needed to meet our client&#8217;s specific financial goals. Also, we could not evaluate properties fast enough to make offers before they were gone.<\/p>\n\n\n\n    \n  <div id=\"visibility-group-block_64dd5ab97ed79\" class=\"visibility-group  hidden\">\n        \n\n<div id=\"hero-block_62df1a82bfc88\" class=\"first:mt-0 hero-block py-4    has-background has-slate-200-background-color has-text-color has-slate-900-color\">\n    <div\n        class=\"gap-10 lg:gap-20 flex flex-wrap lg:flex-nowrap max-w-screen-xl mx-auto px-4 relative lg:items-center \">\n\n        <div class=\"relative z-30 lg:w-2\/3 \">\n            <main class=\"py-4\">\n                \n\n<p class=\"has-large-font-size\"><strong>Analyze Deals Like a Pro<\/strong><\/p>\n\n\n\n<p class=\"my-3 md:my-5 lg:my-8 has-slate-900-color has-text-color\" style=\"font-size:16px\">Deal analysis is one of the first and most critical steps of real estate investing. Maximize your confidence in each deal with this first-ever ultimate guide to deal analysis. <em>Real Estate by the Numbers<\/em> makes real estate math easy, and makes real estate success inevitable. <\/p>\n\n\n\n<div id=button-custom-event-block_64138224164cd class='button-custom-event'>\n      <a\n    href=\"https:\/\/store.biggerpockets.com\/products\/real-estate-by-the-numbers?utm_source=blog&#038;utm_medium=marketing_block\"\n        x-on:click=\"window.analytics.track('Blog Block | Publishing: REBTN Book', {\n      referrer: 'https:\/\/www.biggerpockets.com\/blog\/how-i-use-data-analytics-in-real-estate-investing',\n    });\"\n    class=\" btn-shape inline-block no-underline has-background has-theme-blue-background-color has-text-color has-white-color\" target=\"_blank\">Get Yours Now<\/a>\n  <\/div>\n\n\n\n<div id=button-custom-event-block_641381f7164cc class='button-custom-event'>\n  <\/div>\n\n            <\/main>\n        <\/div>\n\n                <div class=\"lg:w-1\/3 first:mt-0 relative h-full lg:flex lg:items-center\">\n            <img decoding=\"async\" class=\"object-cover w-full relative z-20 my-0  rounded-md hidden lg:block\" src=\"https:\/\/www.biggerpockets.com\/blog\/wp-content\/uploads\/2022\/08\/REBN_cover_mockup_01-e1679000020543.png\" alt=\"real estate by the numbers\" title=\"\">\n        <\/div>\n            <\/div>\n<\/div>\n\n  <\/div>\n  \n\n\n<div class=\"wp-block-group\"><div class=\"wp-block-group__inner-container is-layout-constrained wp-block-group-is-layout-constrained\">\n    \n  <div id=\"visibility-group-block_64dd31c79f00f\" class=\"visibility-group  \">\n        \n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<div id=\"hero-block_64dd2875dba9d\" class=\"first:mt-0 hero-block py-4    has-background has-slate-100-background-color has-text-color has-theme-slate-color\">\n    <div\n        class=\" flex flex-wrap lg:flex-nowrap max-w-screen-xl mx-auto px-4 relative lg:items-center \">\n\n        <div class=\"relative z-30 w-full \">\n            <main class=\"py-4\">\n                \n\n<h3 class=\"wp-block-heading my-0 tracking-tight font-extrabold has-theme-slate-dark-color has-text-color has-large-font-size\">Join the community<\/h3>\n\n\n\n<p class=\"my-3 md:my-5 lg:my-8 has-theme-slate-color has-text-color\" style=\"font-size:16px;font-style:normal;font-weight:400\">Ready to succeed in real estate investing? Create a free BiggerPockets account to learn about investment strategies; ask questions and get answers from our community of +2 million members; connect with investor-friendly agents; and so much more. <\/p>\n\n\n\n<div id=button-custom-event-block_64dd2888dba9e class='button-custom-event'>\n      <a\n    href=\"https:\/\/www.biggerpockets.com\/signup\"\n        x-on:click=\"window.analytics.track('Blog Block | Acquisition | Free Membership Signup', {\n      referrer: 'https:\/\/www.biggerpockets.com\/blog\/how-i-use-data-analytics-in-real-estate-investing',\n    });\"\n    class=\" btn-shape inline-block no-underline has-background has-theme-blue-background-color has-text-color has-white-color\" target=\"_blank\">Sign Up<\/a>\n  <\/div>\n\n            <\/main>\n        <\/div>\n\n            <\/div>\n<\/div>\n\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n  <\/div>\n  <\/div><\/div>\n","protected":false},"excerpt":{"rendered":"<p>Here&#8217;s how I learned to use data analytics, and how you can avoid making my early mistakes.<\/p>\n","protected":false},"author":613715,"featured_media":163704,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[7389,7119],"tags":[],"class_list":["post-163697","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-market-analysis","category-biggerpockets-daily"],"acf":[],"comment_count":0,"_links":{"self":[{"href":"https:\/\/www.biggerpockets.com\/blog\/wp-json\/wp\/v2\/posts\/163697","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.biggerpockets.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.biggerpockets.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.biggerpockets.com\/blog\/wp-json\/wp\/v2\/users\/613715"}],"replies":[{"embeddable":true,"href":"https:\/\/www.biggerpockets.com\/blog\/wp-json\/wp\/v2\/comments?post=163697"}],"version-history":[{"count":0,"href":"https:\/\/www.biggerpockets.com\/blog\/wp-json\/wp\/v2\/posts\/163697\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.biggerpockets.com\/blog\/wp-json\/wp\/v2\/media\/163704"}],"wp:attachment":[{"href":"https:\/\/www.biggerpockets.com\/blog\/wp-json\/wp\/v2\/media?parent=163697"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.biggerpockets.com\/blog\/wp-json\/wp\/v2\/categories?post=163697"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.biggerpockets.com\/blog\/wp-json\/wp\/v2\/tags?post=163697"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}