--- title: Uncovering Hidden Insights with Machine Learning description: Researchers at MIT have developed an algorithm that can process hundreds of thousands of data records to identify actionable new insights. image: https://blog.ams-insights.com/hubfs/machine-learning-for-qualitative-research.jpg --- - [Instagram](https://www.instagram.com/ams_insights) - [Toolkit Login](https://voctoolkit.ams-inc.com/login/) - [Join Us](https://www.ams-inc.com/why-work-at-ams/) - [0 Items](https://ams-insights.com/registration/) [![AMS_web_logo_final](https://blog.ams-insights.com/hubfs/AppliedMarketingScience_June2021/images/AMS_web_logo_final.png)](https://ams-insights.com/) - Services - [Your Business Challenges](https://ams-insights.com/your-business-challenges/) - [Our Solutions](https://ams-insights.com/our-solutions/) - [Who We Help](https://ams-insights.com/who-we-help/) - [Powerful Results](https://ams-insights.com/powerful-results/) - Training - [Train Your Team](https://ams-insights.com/train-your-team/) - [Webinars](https://ams-insights.com/webinars/) - [Public Workshops](https://ams-insights.com/public-workshops/) - Knowledge Center - [Resources](https://ams-insights.com/resources/) - [Insights Blog](https://blog.ams-insights.com/) - [FAQs](https://ams-insights.com/frequently-asked-questions/) - Who We Are - [The AMS Difference](https://ams-insights.com/the-ams-difference/) - [Our Consultants](https://ams-insights.com/our-consultants/) - [Contact Us](https://ams-insights.com/contact-us/) Select Page - Services - [Your Business Challenges](https://ams-insights.com/your-business-challenges/) - [Our Solutions](https://ams-insights.com/our-solutions/) - [Who We Help](https://ams-insights.com/who-we-help/) - [Powerful Results](https://ams-insights.com/powerful-results/) - Training - [Train Your Team](https://ams-insights.com/train-your-team/) - [Webinars](https://ams-insights.com/webinars/) - [Public Workshops](https://ams-insights.com/public-workshops/) - Knowledge Center - [Resources](https://ams-insights.com/resources/) - [Insights Blog](https://blog.ams-insights.com/) - [FAQs](https://ams-insights.com/frequently-asked-questions/) - Who We Are - [The AMS Difference](https://ams-insights.com/the-ams-difference/) - [Our Consultants](https://ams-insights.com/our-consultants/) - [Contact Us](https://ams-insights.com/contact-us/) # Uncovering Hidden Insights with Machine Learning By [Carmel Dibner](https://ams-insights.com/our-consultants/carmel-dibner/) The ultimate measure of successful research in a mature and well-understood category hinges on its ability to uncover new, game-changing insights. But how can you maximize your chances of uncovering truly new insights? One way is to use machine learning to analyze qualitative data to identify infrequently mentioned insights. You might wonder whether infrequently mentioned insights can really be that important. They can be. In fact, it’s a common misconception that infrequently mentioned needs are less important than frequently mentioned needs. Academic research demonstrates otherwise\[1\]. Researchers at MIT have developed an algorithm that can process hundreds of thousands of data records to identify actionable new insights. The data can come from online user generated content (UGC) including user forums, product review sites, and other publicly available data sources. The machine can also be used to mine large amounts of proprietary data, such as call center recordings, open-ended survey responses, or transcripts of qualitative interviews. The machine is powerful and unbiased. It can identify frequently mentioned insights as well as infrequently mentioned ones – those that are only discoverable due to the machine’s ability to process a large amount of data. Time and again, the machine finds “needle in a haystack” insights that researchers often don’t think to ask about and respondents often don’t think to mention during traditional qualitative research. As an example, in conducting a research study on kitchen blenders, the MIT algorithm unearthed unique needs that customers rarely think about until they encounter a specific pain point. Some examples of these unique needs include: - Assured the parts never unscrew themselves while blending - Easy to turn the blender on or off (i.e., the on/off switch doesn't become hard to push) - Blender won’t ruin the surface it’s sitting on When people encounter product issues, such as those implied in the above statements, they frequently go online to write about them. This rich experience-based content is the perfect type of UGC data for machine learning. When sufficient data exists, machine learning is a powerful technique to gather impactful, infrequently heard new insights. To learn more about how machine learning can be used to uncover actionable qualitative insights quickly and cost-effectively, watch our [webinar on demand](https://ams-insights.com/our-latest-thinking/webinars-on-demand/machine-learning/). The webinar, hosted by [Carmel Dibner](https://ams-insights.com/our-consultants/carmel-dibner/), explores how machine learning can be integrated into your research toolkit.  [![Watch now](https://no-cache.hubspot.com/cta/default/2773158/b092092f-677a-4c0f-b330-519d51cd1eae.png)](https://cta-redirect.hubspot.com/cta/redirect/2773158/b092092f-677a-4c0f-b330-519d51cd1eae) \[1\] Griffin, Abbie and John R. Hauser (1993), "The Voice of the Customer," Marketing Science, 12, 1, (Winter), 1-27.   Tags: [Machine Learning/AI](https://blog.ams-insights.com/topic/machine-learning-ai) Share this: - [mailto:?body=https://blog.ams-insights.com/hidden-insights-machine-learning](mailto:?body=https://blog.ams-insights.com/hidden-insights-machine-learning) ### Subscribe Here! ### Categories - [Voice of the Customer (100)](https://blog.ams-insights.com/topic/voice-of-the-customer) - [Machine Learning/AI (62)](https://blog.ams-insights.com/topic/machine-learning-ai) - [Conferences (46)](https://blog.ams-insights.com/topic/conferences) - [News (45)](https://blog.ams-insights.com/topic/news) - [Insights Training (30)](https://blog.ams-insights.com/topic/insights-training) - [Medical Products and Pharmaceuticals (21)](https://blog.ams-insights.com/topic/medical-products-and-pharmaceuticals) - [Journey Mapping (20)](https://blog.ams-insights.com/topic/journey-mapping) - [Conjoint Analysis and Discrete Choice (12)](https://blog.ams-insights.com/topic/conjoint-analysis-and-discrete-choice) - [Kristyn Corrigan (12)](https://blog.ams-insights.com/topic/kristyn-corrigan) - [Ethnography (11)](https://blog.ams-insights.com/topic/ethnography) - [Heavy Equipment (10)](https://blog.ams-insights.com/topic/heavy-equipment) - [Carmel Dibner (8)](https://blog.ams-insights.com/topic/carmel-dibner) - [Engineered Products and Components (8)](https://blog.ams-insights.com/topic/engineered-products-and-components) - [John Mitchell (8)](https://blog.ams-insights.com/topic/john-mitchell) - [Podcast (8)](https://blog.ams-insights.com/topic/podcast) - [Building Materials and Durables (7)](https://blog.ams-insights.com/topic/building-materials-and-durables) - [Chemicals, Coating and Additives (7)](https://blog.ams-insights.com/topic/chemicals-coating-and-additives) - [Consumer Durables (7)](https://blog.ams-insights.com/topic/consumer-durables) - [Recruiting Respondents (7)](https://blog.ams-insights.com/topic/recruiting-respondents) - [Technology and Telecommunications (7)](https://blog.ams-insights.com/topic/technology-and-telecommunications) - [Consumer Products (6)](https://blog.ams-insights.com/topic/consumer-products) - [Manufacturing (6)](https://blog.ams-insights.com/topic/manufacturing) - [Travel, Logistics and Hospitality (6)](https://blog.ams-insights.com/topic/travel-logistics-and-hospitality) - [Quality Function Deployment (QFD) (4)](https://blog.ams-insights.com/topic/quality-function-deployment-qfd) - [Claims Development and Testing (3)](https://blog.ams-insights.com/topic/claims-development-and-testing) - [Concept Testing (3)](https://blog.ams-insights.com/topic/concept-testing) - [Meaghan Foley (3)](https://blog.ams-insights.com/topic/meaghan-foley) - [Segmentation & Market Sizing (3)](https://blog.ams-insights.com/topic/segmentation-market-sizing) - [Agriculture and Fisheries (2)](https://blog.ams-insights.com/topic/agriculture-and-fisheries) - [Banking, Investing and Insurance (1)](https://blog.ams-insights.com/topic/banking-investing-and-insurance) - [Business Services (1)](https://blog.ams-insights.com/topic/business-services) - [Legal Services (1)](https://blog.ams-insights.com/topic/legal-services) - [Oil and Gas (1)](https://blog.ams-insights.com/topic/oil-and-gas) - [Patty Yanes (1)](https://blog.ams-insights.com/topic/patty-yanes) See all ### Get in Touch - [(781) 250-6300](tel:(781)%20250-6300) - [inquiry@ams-inc.com](mailto:inquiry@ams-inc.com) - Applied Marketing Science, 78 Blanchard Road, Suite 203, Burlington MA 01803 ### Affiliations [![logo2](https://blog.ams-insights.com/hubfs/AppliedMarketingScience_June2021/images/logo2.png)](https://www.pdma.org/) [![AMA-logo-white](https://blog.ams-insights.com/hubfs/AppliedMarketingScience_June2021/images/AMA-logo-white.png)](https://www.ama.org/) [![cxpa-logo-white](https://blog.ams-insights.com/hubfs/AppliedMarketingScience_June2021/images/cxpa-logo-white.png)](https://www.cxpa.org/) [![MAN_logo_horizontal_white](https://blog.ams-insights.com/hubfs/AppliedMarketingScience_June2021/images/MAN_logo_horizontal_white.png)](https://www.mapi.net/) [![insights_logo-light](https://blog.ams-insights.com/hubfs/AppliedMarketingScience_June2021/images/insights_logo-light.png)](https://www.insightsassociation.org/) [![ISBM-logo-white](https://blog.ams-insights.com/hubfs/AppliedMarketingScience_June2021/images/ISBM-logo-white.png)](https://isbm.smeal.psu.edu/) ©2025 Applied Marketing Science, Inc. | [Sitemap](https://ams-insights.com/sitemap_index.xml) | [Terms of Use](https://ams-insights.com/terms-of-use/) | [Privacy Policy](https://ams-insights.com/privacy-policy) Follow Us: - - - ![](https://dc.ads.linkedin.com/collect/?pid=19853&fmt=gif)