The quest for actionable insights and answers from within vast troves of data is neverending within the modern enterprise. There’s good reason for that – it is the end goal of all information work – but the process is anything but optimized. Global analytics firm Forrester revealed as much in a 2017 report, which found that more than 54% of global information workers are interrupted from their work a few times or more per month by time wasted trying to gain access to information, insights, and answers.
It’s a problem that goes far beyond the limitations of conventional enterprise search technology – it’s a Sisyphean challenge, thanks to the sheer volume of data being created every single second.
“As organizations in data-intensive industries strive to create value, enhance customer experiences, and differentiate themselves from their competition, they are placing demands on their knowledge workers in unprecedented ways,” explains Laurent Fanichet, VP of Marketing for Sinequa. “Frequently, the data and knowledge they are looking for is isolated, segmented, and fractured. It’s difficult to surface the right information at the right time to see the patterns in the data.”
Fanichet has a clear grasp on the key problem Sinequa, an independent software vendor specialising in cognitive search & analytics, is trying to address. In its recent report, Forrester Wave: Cognitive Search and Knowledge Discovery Solutions, (Q2 2017), Forrester defines cognitive search as ‘the new generation of enterprise search that employs AI technologies such as natural language processing and machine learning to ingest, understand, organize, and query digital content’ – and, in the same report, go on to highlight Sinequa for the applications of their NLP technology in enterprise search.
The kind of cognitive search and analytics platform Sinequa offers, Fanichet explains, refers to an information system that is capable of automatically extracting relevant insights from diverse enterprise datasets for users within a specific work context. “Cognitive search brings the power of AI to enterprise search,” he says. “It helps organizations in data-intensive industries to become information driven.”
A recent IBM Watson report highlights the applications of cognitive search in the aerospace sector. One company uses these enhanced search capabilities “to improve supply chain visibility and reduce cycle time, saving millions of dollars on critical parts deliveries.” Furthermore, the system enables aircraft technicians to search through “reams” of maintenance records and technical documentation. “Now, if a worker needs to know what’s causing high hydraulic oil temperatures, the [cognitive solution] identifies historical cases with similar circumstances, finding patterns that point to the root cause of the overheating.” The report goes on to note that the solution in question saves the airline manufacturer up to $36 million per year.
Cognitive search and analytics likewise has its applications in the health and pharma sector. AI Business recently spoke to Karenann Terrell, GlaxoSmithKline’s first ever Chief Data and Analytics Officer, and former CIO of Walmart. She explained that a big component of what it takes to develop medicine can benefit from next-generation computing and machine learning. “Approximately 1/3 of the total cost of developing a medicine (>$2.5bn) is spent during the time it takes from identifying your target (the process in the body that you want to affect) to testing your molecule in humans for the first time,” she explained. “This process can take around five years. [GSK’s] goal with artificial intelligence is to reduce this time to just one year in future.”
“These are just a few of the many business areas where surfacing the information from within their data can drive better decisions,” Fanichet argues. He explains that cognitive search and analytics also have a range of powerful potential applications within customer service, enabling organizations to:
- Provide personalized and highly relevant communication to their customers
- Nurture customer relationships and prevent customer churn
- Improve productivity, reduce operating expenses, and gain operational efficiencies
- Minimize customer service representative turnover and knowledge loss
The Challenges Ahead for Cognitive Search
The potential use cases speak for themselves, but that doesn’t mean there aren’t challenges ahead for enterprises looking to incorporate cognitive search technology into their work. While working with clients, Fanichet explains, Sinequa helps them to understand that there are a set of common machine learning challenges along the path ahead. Expertise is often the first hurdle, but he maintains that there are many different types of AI implementation challenge. “Assuming that enterprises are able to resolve a dearth of expertise, there are still other challenges – most of which are specific to the type of AI being pursued.”
Take supervised machine learning, where the system learns to recognize patterns by observing ‘correct’ patterns provided by humans. “The greatest challenge is around providing sufficiently labelled training datasets from which the system can learn,” Fanichet explains. This is something Matt Buskell highlights in his ‘10 keys to AI implementation‘, recommending that following the initial loading of data and knowledge base, the system needs to go through a phase of refinement once the software has launched. “During this phase, things like gain and variance for Machine Learning, or intent training for NLP and maybe model refinement to cognitive reasoning need to be improved. During this phase, it is essential to carefully release the software and measure how well it’s performing over a 6-12 week period, at the least.”
Fanichet likewise highlights the obstacles unique to unsupervised machine learning, in which the system identifies existing patterns and a human determines their usefulness. “The greatest challenge is balancing the system’s need for sufficient data with the proper human guidance and interpretation needed to train the system,” Fanichet argues. This is as much an issue of skills and process culture as it is technical expertise, and is reflected in a recent Genpact survey of over 300 senior executives, which argues “AI cannot be implemented piecemeal. It must be part of the organisation’s overall business plan, along with aligned resources, structures, and processes.” Collaboration is therefore key.
Finally, there’s a need to formulate clear goals and outcomes, Fanichet says. “When pursuing reinforcement learning, where the system makes many attempts and learns from the outcome to take better actions, the greatest challenge is providing the system with a defined goal and sufficient practice in a dynamic environment so that the system can effectively learn from trial and error.”
Sinequa Brings the Power of AI to Enterprise Search
Fanichet believes Sinequa offer a range of unique intelligent capabilities within the analytics space:
- Robust Indexing Engine: “If cognitive search was all about matching a keyword, a single index would suffice. The best results are obtained when multiple indexes are combined, each providing a different perspective or emphasis, providing a comprehensive overview of the information available. This provides the best possible understanding of the meaning it carries.”
- Enterprise Grade: “Sinequa was designed from the start to support the complexities and multiple security layers of today’s enterprises. It was also designed to be immersed in diverse enterprise environments and can operate within the context of a specific industry and the language of the specific organization.”
- Topically Aware: “Connecting information along topical lines across all repositories surfaces the collective expertise of the organization and makes it transparent. This is especially valuable in large organizations that are geographically distributed. By connecting people with expertise, the overall responsiveness of the organization increases.”
- Natural Language Processing: “Sinequa’s world-class NLP offers automated language detection; lexical and syntactical analysis; and automatic extraction of dozens of entity types, including concepts and named entities like people, places, companies, etc. It also supports text mining agenda that is integrated into the indexing engine. This enables the extraction of virtually any function, relationship, or complex concept from the content.”
- Machine Learning: “Sinequa leverages ML to enhance and improve search results and relevancy. This is done during ingestion but also constantly in the background as humans interact with Sinequa. It has become an essential part of the platform since it can handle complexity beyond what’s possible with rules.”
- Well Designed User Experience: “Sinequa’s front-end serves as an intelligent agent that employees can consult for institutional knowledge that can be readily applied to the task or situation at hand. The experience is well designed in the sense that it is aesthetically pleasing, it is understandable in that it makes use of the user’s intuition, it is unobtrusive, and perhaps most importantly, it is contextual to the user’s goals.”
- Ubiquitous Connectivity: “Sinequa’s product comes with over 160 ready-to-use connectors, all of which were developed in-house, thus ensuring consistency, quality control, and high performance.”
Forrester, one of the leading analyst firms, defines Cognitive Search in a recent report¹ as: The new generation of enterprise search that employs AI technologies such as natural language processing and machine learning to ingest, understand, organize, and query digital content from multiple data sources. Here is a shorter version, easy to memorize: Cognitive Search = Search + NLP + AI/ML
Of course, “search” in this equation is not the old keyword search but high-performance search integrating different kinds of analytics. Natural Language Processing (NLP) is not just statistical treatment of languages but comprises deep linguistic and semantic analysis. And AI is not just “sprinkled” on an old search framework but part of an integrated, scalable, end-to-end architecture.
AI Needs Data, Lots of Data
For AI and ML algorithms to work well, they need to be fed with as much data you can get at. A cognitive search platform must access the vast majority of data sources of an enterprise: internal and external data of all types, data on premises and in the cloud. Hence the system must be highly scalable.
Cognitive Search uses NLP and machine learning to accumulate knowledge about structured and unstructured data and about user preferences and behavior. That is how users get ever more relevant information in their work context. To accumulate knowledge, a cognitive search platform needs a repository for this knowledge. We call that a “Logical Data Warehouse” (LDW).
The Strength of Combination
To produce the best possible results, the different analytical methods must be combined, not just executed in isolation of each other. For example, machine learning algorithms deliver much better results much faster if they work on textual data for which linguistic and semantic analyses have already extracted concepts and relationships between concepts.
Get your copy of the full paper here and learn more about current use cases of cognitive search and AI at large information-driven companies.
(1) Forrester Wave: Cognitive Search & Knowledge Discovery Solutions, Q2 2017
Read the full report on https://www.sinequa.com/forrester-wave-2017/
Sinequa has taken part for the 4th consecutive year in Bio IT World Conference & Expo on May 23-25 in Boston. We’ve been delighted to meet with our Biopharma and Life Science customers and partners at the show and share innovative use cases of our solution for the Pharma industry via live demos.
“OPEN” LIVE DEMOS
Bio IT World conference is always for us a great venue to showcase our platform and present how leading biopharma organizations leverage our Cognitive Search & Analytics platform. This year, the attendees were very interested to see how Sinequa combines advanced Search, NLP and Machine Learning capabilities to extract relevant insight from vast structured and unstructured data silos.
ALEXION’S CONTENT ANALYSIS PROJECT: MINING CONTENT FOR ACTIONABLE INSIGHT WITH SINEQUA
In our joint talk, our customer Alexion shared a testimonial on the implementation of Sinequa for their content analysis project. The presentation highlighted the technology and approaches they used with advanced data visualizations that help explain information sources. ICYMI – please feel free to get your copy here.
UNLIMITED THEATER PRESENTATIONS
Once again, we were very pleased to see the strong interest of many biopharma professionals toward Sinequa insight platform. Our team gave more than a hundred presentations and live demos in the Sinequa Theater Area where they explained a large panel of use cases including R&D Enterprise Search, Clinical Trial Data Discovery & Exploration, Key Opinion Leaders & Subject Matter Experts… .) We hope you enjoyed the conference as much as we did and you could understand how our Cognitive Search & Analytics platform enable leading pharmaceutical organizations drive innovation, accelerate research and shorten drug Time-to-Market. We are already getting excited for next year’s edition! See you all in spring 2018!
Forces of global competition, narrow margins, higher product development costs, and tenuous exclusivity holds drive organizations to push innovation, seek cost cutting strategies, and go-to-market as quickly as possible. Demands change frequently while regulatory and compliance standards become even more stringent. Organizations must keep up, and the pressure on research and development (R&D) never stops. R&D is the critical driver within the organization, whether within a large aircraft manufacturer or a leading automobile company looking to develop cutting edge products and services or a pharmaceutical company accelerating time-to-market for new drugs or a CPG company reinventing waning products. R&D thrives on information: customer information, expert information, product information, scientific information, market information, and competitive information.
To be at the forefront of innovation, R&D departments need complete visibility into both new and historical information across the entire enterprise as well as access to research from external public and premium information services. This is no simple task in today’s world where we are inundated with data — more data, more opportunities and more challenges. As a result, many companies depend on Cognitive Search and Analytics (CS&A) solutions to harness insightful, high-quality information and fuel innovation within their product and solution portfolios.
THE PRESSURE ON R&D
As organizations strive to create value, enhance customer experiences, and differentiate themselves from their competition, they have placed demands on their R&D departments to:
- Accelerate delivery of innovative products to market
- Optimize and manage available resources and knowledge while leveraging intellectual property
- Devise methods to reduce product development costs and eliminate re-work
- Improve product compliance both internally and externally and deliver safer, compliant products faster
- Understand consumer and market demands and improve responsiveness
- Resolve product issues quickly and efficiently to gain and keep customer trust
To meet these demands, R&D depends on complex scientific and engineering content that contains implicit conceptual relationships that can and should be semantically linked to simplify access to the knowledge embedded in that content.
HOW COGNITIVE SEARCH AND ANALYTICS HELPS
Cognitive Search and Analytics solutions amplify the expertise of R&D departments by surfacing insights from data across the enterprise, irrespective of location and format. From a single, secure access point, these solutions enable R&D professionals to unlock relevant and timely product research that helps make informed decisions. In addition, these capabilities are not limited to internal information; users can quickly access information from external Web sites and other applications, deriving relevant information and seamlessly integrating with internal enterprise information.
Cognitive Search and Analytics solutions enable enterprises to maximize the value of their intellectual property. Powerful search relevance and navigation capabilities enable researchers to find valuable pieces of past research and even parallel work going on without each group knowing about the other — eliminating duplicate work, reducing time spent in trials and shortening development cycles. These solutions allow employees to tag, bookmark and comment on documents, enabling collaboration and making teams more innovative, efficient and productive. Surfacing this existing knowledge enables workers to leverage the past work of distant or former researchers to benefit future research. Dynamically delivering relevant information, surfacing knowledge and enabling collaboration can decrease R&D costs significantly. Because R&D departments need to comply with a myriad of complex regulations, they need to be aware of relevant regulations without having to sift through the myriads themselves. This visibility enables R&D to stay abreast of regulatory mandates and efficiently manage compliance. Organizations can also leverage these solutions to send alerts to employees when there are new policy and compliance changes so that relevant R&D stakeholders are immediately notified.
Managing and maintaining product specifications is a critical function within R&D. Cognitive Search and Analytics solutions can access virtually any data source and expose changes when information is deleted or becomes outdated. These solutions can alert workers when any new information is created that impacts their specific process in the development cycle. These solutions also track and respect the access permissions accorded by each target application; only those with the correct privileges can access restricted information. Cognitive Search & Analytics solutions give researchers clear insight into product requirements and enable them to collaboratively develop safer, higher quality products that meet regulatory requirements.
RAPID RETRIEVAL OF RELEVANT INFORMATION MAKES THE DIFFERENCE
Extracting relevant information from vast and complex data volumes is a challenge that requires a sophisticated and scalable solution. The Sinequa Cognitive Search and Analytics platform handles all structured and unstructured data sources and uses Natural Language Processing (NLP), statistical analysis and Machine Learning (ML) to create an enriched “Logical Data Warehouse” (LDW). You can think of it as a repository of information about data and about relationships between data, people, concepts, etc. This LDW is optimized for performance in delivering rapid responses to users’ information needs. Users can ask questions in their native language or ask that relevant information be “pushed” to them in a timely fashion when it emerges. More than 150 connectors ready for use “out of the box” make the process of connecting multiple data sources fast and seamless. Company and industry-specific dictionaries and ontologies can be easily integrated, putting domain-specific knowledge “under the hood” of the Sinequa platform, making it an intelligent partner for anyone in search of relevant information.
The advanced semantic capabilities within Sinequa’s platform provide strong relevance in 21 different languages to assist organizations with even the most geographically and linguistically diverse workforce.
REAL-WORLD EXAMPLE: AMPLIFYING BIOPHARMA EXPERTISE
Consider one of Sinequa’s biopharma customers, a research-intensive organization dealing with a vast number of highly technical documents, produced both in-house and externally. The information in these documents varies according to the field of its origin – e.g. medical, pharmaceutical, biological, chemical, biochemical, genetic, etc. – and may deal with diseases, genes, drugs/active agents, and mechanisms of action. A lot of the information is textual, but there is also structured information, like molecular structures, formulae, curves, diagrams, etc. The volume of this information is on the order of magnitude of about 500 million documents and billions of database records.
Now consider the more than 10,000 R&D experts within the organization trying to leverage this information daily. They need to be able to ask topical questions, find relevant people and documents, and explore the vast information landscape to discover knowledge. The Sinequa platform supports this by plowing through the hundreds of millions of documents and equally large amounts of structured data, analyzing the data, analyzing the natural language user queries, and classifying results by category in real time. With the data tamed and enriched, it is presented to the user via a simple, intuitive interface with faceted navigation aids that allow the user to filter results further based on structural attributes that are either explicit or were intelligently derived by the system. The interfaces, also referred to as search-based applications (SBAs) are configured to expose functionality that is very specific to an R&D expert, aligning the solution with the goals of the user.
The Sinequa solution has proven to be very valuable to the customer in question, putting both internal and external research–related information that scientists need for research, development, and decision making into a single virtual repository with advanced navigation and retrieval capabilities. It has also proved to be very beneficial to teams of research and development contributors by allowing experts around the world to collaborate more easily through a single research application. Features such as navigation by topic across multiple repositories, de-duplication of similar documents, and improved research capabilities have all made knowledge workers more efficient and innovative.
Sinequa’s Cognitive Search & Analytics platform leverages relevant customer and market information to give R&D organizations insight and the ability to react quickly to demands. Teams utilize this platform to collaborate and share information. Sinequa effectively eliminates data silos and delivers relevant information from data to users in their business context, such that they can make better decisions, drive innovation, reduce risk, and be more efficient, which in turn enables forward-thinking R&D departments that thrive on continuous product improvements and introductions to amplify the collective expertise of the organization.